-- Logs begin at Fri 2022-08-12 10:27:14 UTC, end at Fri 2022-08-12 11:08:47 UTC. -- Aug 12 10:57:53.897848 dv-cinder-852828-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 12 10:57:53.908233 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 10:57:53 2022] *** Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: nodename: dv-cinder-852828-1-iscsi Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: machine: x86_64 Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: clock source: unix Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: pcre jit disabled Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: detected number of CPU cores: 4 Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: current working directory: / Aug 12 10:57:53.910304 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: detected binary path: /usr/bin/uwsgi-core Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: your processes number limit is 47680 Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: your memory page size is 4096 bytes Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: detected max file descriptor number: 2048 Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: lock engine: pthread robust mutexes Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: thunder lock: enabled Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 12 10:57:53.910953 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 10:57:53.951354 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: Python main interpreter initialized at 0x56176d0c39c0 Aug 12 10:57:53.951354 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: python threads support enabled Aug 12 10:57:53.951354 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: your server socket listen backlog is limited to 100 connections Aug 12 10:57:53.951354 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: your mercy for graceful operations on workers is 90 seconds Aug 12 10:57:53.951691 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 10:57:53.951770 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: *** Operational MODE: preforking *** Aug 12 10:57:53.952035 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: *** uWSGI is running in multiple interpreter mode *** Aug 12 10:57:53.952035 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: spawned uWSGI master process (pid: 81699) Aug 12 10:57:53.952231 dv-cinder-852828-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 12 10:57:53.957941 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: spawned uWSGI worker 1 (pid: 81711, cores: 1) Aug 12 10:57:53.957941 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: spawned uWSGI worker 2 (pid: 81712, cores: 1) Aug 12 10:57:53.957941 dv-cinder-852828-1-iscsi devstack@keystone.service[81699]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 10:57:59.564744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:57:59.564744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: from cryptography.utils import int_from_bytes Aug 12 10:57:59.565531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:57:59.565531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: from cryptography.utils import int_from_bytes Aug 12 10:57:59.566168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:57:59.566168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: from cryptography.utils import int_from_bytes Aug 12 10:57:59.566618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:57:59.566618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: from cryptography.utils import int_from_bytes Aug 12 10:57:59.614987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:57:59.615175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:57:59.615369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] command line args: [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:57:59.615637 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:57:59.615816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ================================================================================ {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:57:59.616116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] admin_token = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.616264 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:57:59.616402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] config_dir = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.616479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:57:59.616590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.616674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] command line args: [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:57:59.616772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] config_source = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.616950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] debug = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.617026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:57:59.617147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.617392 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ================================================================================ {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:57:59.617464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] admin_token = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.617591 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.617721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] config_dir = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.617827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.617953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618075 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] config_source = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] debug = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_config_append = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.618951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619064 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619064 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_dir = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619346 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_file = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619737 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_config_append = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.619937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_dir = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620231 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_file = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620327 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620473 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.620953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621309 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621822 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.621986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622411 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.622954 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.623078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.623268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.623349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.623517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.623794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.623871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] publish_errors = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] publish_errors = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.624943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625254 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625522 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] standard_threads = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.625877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] standard_threads = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626271 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626446 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] use_journal = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] use_json = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] use_journal = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] use_stderr = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] use_json = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.626942 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] use_syslog = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.627030 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] use_stderr = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.627145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] use_syslog = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.627227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.627382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:57:59.627493 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.627644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.627804 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.627884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628098 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628181 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628629 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628875 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.628991 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629406 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629687 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.629970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.630147 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.630309 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.630386 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.630629 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.630743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.630871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631076 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631335 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631821 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.631909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632540 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.632873 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.633840 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634325 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634488 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.634946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635424 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635501 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635750 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.635975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636372 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.636929 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.637596 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.637673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.637829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638006 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638126 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638545 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638652 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638873 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.638936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639089 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639394 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.639895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640014 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640828 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.640988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641214 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641295 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641448 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.641932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642168 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642401 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.642961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643110 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643826 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.643903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644133 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644327 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644540 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.644816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645003 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645318 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.645791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646020 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646429 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.646979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.647923 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648158 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.648879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649031 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649272 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649744 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.649998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650323 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.650925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651237 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651386 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.651929 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.652085 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.652162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.652330 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.652415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.652587 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.653316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.653499 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.653581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.653651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.653731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.external = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.653950 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.external = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654703 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.password = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.654938 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] auth.token = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655167 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.password = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] auth.token = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655640 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655873 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.655953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656669 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.656917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657300 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657792 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.657869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658296 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658539 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.658852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659035 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659528 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.659866 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660799 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.660876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661041 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661119 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661272 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661505 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.661827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662246 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662489 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662567 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662723 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.662973 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663052 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663284 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.663932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664017 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664166 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664408 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664648 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.664959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.665114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.665192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.665351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.665428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.665579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.665939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666826 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.666902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667055 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667284 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667528 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.667851 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668094 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668631 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.668882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669120 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.669822 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670095 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670317 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670713 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.670962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671038 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671684 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.671930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672007 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672253 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672408 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672487 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672635 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.672956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673412 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673653 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673804 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.673880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674136 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674293 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674539 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.674848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675477 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.675948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676181 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676643 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.676956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677215 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677842 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.677959 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678333 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678409 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.678872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679493 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.679980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680221 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680455 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680694 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680921 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.680999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.681858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682006 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682117 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682605 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682840 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.682920 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683389 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683555 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683635 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.683923 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684149 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684391 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684780 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.684858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685087 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685246 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685563 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.685994 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686310 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686846 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.686956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687275 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687430 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687507 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] role.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] role.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.687906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] role.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] role.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688230 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.688955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.689960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690611 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.690937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691104 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691501 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.691969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692205 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692531 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.692940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.693872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694048 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694364 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694520 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694610 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694831 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.694992 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695070 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695807 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.695963 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696048 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696426 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.696976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697221 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.697962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698860 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.698945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.699096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.699174 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.699338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.699936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.700199 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.700281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.700481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.700559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.700734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.700871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701040 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701120 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.connection = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701395 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.701894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.connection = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702104 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702355 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702433 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702668 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.702918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703303 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703535 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.703835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704233 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704474 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704785 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.704952 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705426 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.705813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:57:59.705883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.706138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:57:59.706306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:57:59.735347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.735538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.735770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.737054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.737286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.737506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.745606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.748255 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.775179 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.775413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.776350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.776581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.829101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.829681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.878856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.879088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.880547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.880788 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.943532 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.943702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.943789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.943925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944145 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944227 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944473 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.944894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.967925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968317 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968403 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968550 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.968988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.969057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.969202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.969281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.969414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.969630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.980079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.980597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.992680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.992914 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.993863 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.994019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81712) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.994103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.994288 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.994504 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:57:59.994721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81711) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:58:00.011268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.011475 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:58:00.011558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.011686 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:58:00.011817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.012144 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.012242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:58:00.012395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:58:00.012533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.012660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.012839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.012912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.013105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.013239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.013366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.013512 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.024689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.024871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.025000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.025156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.025285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.025450 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.025588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.025712 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.033162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.033256 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.036263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.036349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.036546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.036627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.036829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.036922 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037394 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.037952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038494 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.038847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.039035 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.039124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.062898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.063581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.064386 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.064670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.065125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.065420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.069286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.069570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.069852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.070117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.070411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.070704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.076774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.077058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.077479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.077774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.081178 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.081467 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.081751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.081869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.082062 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.082193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.082350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.082483 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.082634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.082772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.082911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.083058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.083188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.083344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.083624 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.083900 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.099592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.099872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.100360 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.100648 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.103858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.104658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.107107 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.107402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.108185 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.108490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.111802 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.112922 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.114991 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.116196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.118176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.118475 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.118761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.119056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.119335 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.119441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.119624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.119748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.120045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.120348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.120635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.120933 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.135581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.135874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.136144 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.136409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.138118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.138423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.138701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.138974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.143858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.145421 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.145701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.145969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.147574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.147860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.148543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.148829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.149121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.149415 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.149695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.150789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.151083 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.151394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.151692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.151979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.161162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.161448 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.161732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.162040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.162321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.162603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.162879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.163876 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.164166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.164452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.164739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.165028 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.165311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.165597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.180354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.183193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.183358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.186291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.186594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.188180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.189284 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.189675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.189998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.190284 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.190907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.192425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.192724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.193022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.196764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.198365 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.200093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.201737 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.201826 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.202123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.202409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.202685 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.204739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.205037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.205325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.205609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.211518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.211825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.212125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.213864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.214198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.214497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.219647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81712) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.219933 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.220219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.220500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.220778 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.221063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.221343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.221615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222021 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81711) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:58:00.222106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222388 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.222945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.223145 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.223225 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.223416 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81712) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.223502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.223706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.223992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.224373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.224664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.224954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.225243 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.225520 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.225792 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81711) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:58:00.257094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56176d0c39c0 pid: 81712 (default app) Aug 12 10:58:00.259412 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56176d0c39c0 pid: 81711 (default app) Aug 12 10:58:00.260350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca033c-08fb-448a-b975-e1e3a9f0a9f8 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:00.260634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca033c-08fb-448a-b975-e1e3a9f0a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:00.260905 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca033c-08fb-448a-b975-e1e3a9f0a9f8 None None] PATH_INFO: `/v3` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:00.265791 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Fri Aug 12 10:58:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:08.473656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:08.474151 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:08.474229 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:08.478678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:08.483966 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84000919-1f80-40ba-a112-72fec767122a None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:08.484360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84000919-1f80-40ba-a112-72fec767122a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:08.484507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84000919-1f80-40ba-a112-72fec767122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:08.553574 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: INFO dbcounter [None req-84000919-1f80-40ba-a112-72fec767122a None None] Registered counter for database keystone Aug 12 10:58:08.572306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG oslo_db.sqlalchemy.engines [None req-84000919-1f80-40ba-a112-72fec767122a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:58:08.579135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writer thread running {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:58:08.754613 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG passlib.handlers.bcrypt [None req-84000919-1f80-40ba-a112-72fec767122a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81712) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 10:58:08.755037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG passlib.handlers.bcrypt [None req-84000919-1f80-40ba-a112-72fec767122a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81712) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 10:58:08.810064 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-84000919-1f80-40ba-a112-72fec767122a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:08.811686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-84000919-1f80-40ba-a112-72fec767122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:08.942275 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 12 10:58:09.441680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:09.512213 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: INFO dbcounter [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] Registered counter for database keystone Aug 12 10:58:09.533860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG oslo_db.sqlalchemy.engines [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:58:09.540019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writer thread running {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:58:09.660232 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6ba8-1d9b-4200-a469-30474223ab10 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:09.664547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '254545a5250741a0bf9da613f7749ee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:09.665442 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:09.665985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:09.666272 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:09.675216 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:09.727446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 10:58:09.727725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e1031-b5c6-41e5-bcc3-7f453f48e091 admin admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:09.738068 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Fri Aug 12 10:58:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 10:58:09.744034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84000919-1f80-40ba-a112-72fec767122a None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:09.758598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84000919-1f80-40ba-a112-72fec767122a None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:09.762959 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '254545a5250741a0bf9da613f7749ee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:09.764049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:09.764331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:09.764603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] PATH_INFO: `/v3/projects/254545a5250741a0bf9da613f7749ee7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:09.766052 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=254545a5250741a0bf9da613f7749ee7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:09.817215 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 10:58:09.817553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18af2cf-a3f3-4d0b-9825-3fa03b6691b7 admin admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:09.822132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Fri Aug 12 10:58:09 2022] GET /identity/v3/projects/254545a5250741a0bf9da613f7749ee7 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:11.681782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f870-00ad-4460-bd30-f5501d654c96 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:11.682366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f870-00ad-4460-bd30-f5501d654c96 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:11.682366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f870-00ad-4460-bd30-f5501d654c96 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:11.686697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:11.691846 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:11.692227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:11.692395 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:11.713682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:11.715210 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:11.723827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 10:58:11.993154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f870-00ad-4460-bd30-f5501d654c96 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:12.005415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f870-00ad-4460-bd30-f5501d654c96 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:12.009645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6818b5-d716-4bde-bb17-d983d9e9ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '254545a5250741a0bf9da613f7749ee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:12.010274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6818b5-d716-4bde-bb17-d983d9e9ceeb admin admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:12.010557 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6818b5-d716-4bde-bb17-d983d9e9ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:12.010829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6818b5-d716-4bde-bb17-d983d9e9ceeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:12.018526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6818b5-d716-4bde-bb17-d983d9e9ceeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:12.020293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6818b5-d716-4bde-bb17-d983d9e9ceeb admin admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:12.029534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Fri Aug 12 10:58:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 10:58:12.035036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:12.045017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3349ca-078c-480b-8b11-a95198dbb324 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:12.049315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c23b49-fec1-47a4-b98f-d1b4a67e5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '254545a5250741a0bf9da613f7749ee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:12.049960 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c23b49-fec1-47a4-b98f-d1b4a67e5b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:12.050243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c23b49-fec1-47a4-b98f-d1b4a67e5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:12.050512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c23b49-fec1-47a4-b98f-d1b4a67e5b08 admin admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:12.051806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c23b49-fec1-47a4-b98f-d1b4a67e5b08 admin admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:12.053590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c23b49-fec1-47a4-b98f-d1b4a67e5b08 admin admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:12.055138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Fri Aug 12 10:58:12 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:14.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6954a4b-34bb-42cc-969c-6d8d53abcad1 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.050715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6954a4b-34bb-42cc-969c-6d8d53abcad1 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.050715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6954a4b-34bb-42cc-969c-6d8d53abcad1 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.052036 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:14.056571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb92a-3e33-4fe9-991c-1dbe086c0556 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.056985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb92a-3e33-4fe9-991c-1dbe086c0556 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.057081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.057168 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb92a-3e33-4fe9-991c-1dbe086c0556 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.057293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.057572 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.058442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:14.064127 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.064410 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.064686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.082782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:14.083950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:14.102931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG passlib.handlers.bcrypt [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81711) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 10:58:14.103351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG passlib.handlers.bcrypt [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81711) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 10:58:14.148597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:14.150204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:14.163165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 7/12] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:14.247079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 6/13] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:14.429481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:14.454209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:14.518196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:14.531917 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3bbc7-50bd-4213-ba98-f52678e7a4eb None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:14.566519 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:14.567142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.567425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.567702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.617156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e1f7-5e99-408d-b615-63def3be9e05 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:14.619443 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:14.633976 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:14.635556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:14.656162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:14.657335 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.657705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.658047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.658998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:14.670601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:14.679066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:14.680111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:14.680956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:58:14.686166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:14.735897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:14.741388 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:14.785643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645220-396d-47b7-a695-7a3e0da52921 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:14.818920 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:14.819523 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.819803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.820075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.820738 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:14.821044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:14.822503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:14.836409 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 8/16] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:14.838441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de67d1-ae2c-4425-8b3a-9d634e6a92f3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:14.842518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:14.870419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:14.946894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b13dd-fe45-4255-99f6-81a093be5e16 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:14.967912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:14.979116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:14.982742 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.982742 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.982742 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.983004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:14.983004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:14.983004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:14.983004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:14.984129 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:14.985589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:14.987219 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:14 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:14.990548 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:14.992001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:14.992978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:58:15.010537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:15.011447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:58:15.012844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:58:15.012844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:58:15.012844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:15.012844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:58:15.018263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:15.089138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:15.095623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a127-88c0-420a-bbb7-8ba04e719700 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:15.120128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee0fc2-ab39-40e0-a4fe-4598eef7f9bc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:15.129761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:15.130429 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:15.130710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:15.130984 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:15.132111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:15.133563 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:15.135139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:15.140976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:15.153985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:15.154605 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:15.154891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:15.155162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:15.155811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:15.156117 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:15.157486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6675831-e50d-4026-9fce-cad1598a5893 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:15.174815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:15.244164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3a37-3fbe-4a66-893c-a27d3771abd7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:15.280359 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:15.280987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:15.281273 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:15.281554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:15.282322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.domain.id=default, user.id=4eef8c08fd624006b0498b56eda3d377) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:15.282637 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:15.284102 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529d4e0-caba-4d40-b9dd-33d39bde6f78 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:15.293256 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Fri Aug 12 10:58:15 2022] GET /identity/v3/role_assignments?user.id=4eef8c08fd624006b0498b56eda3d377&scope.domain.id=default&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:17.439219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbb5c-08d9-4a89-8196-bcfb0673d3a5 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:17.440067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbb5c-08d9-4a89-8196-bcfb0673d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:17.440549 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbb5c-08d9-4a89-8196-bcfb0673d3a5 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:17.442139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:17.451312 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84f3d-59c2-4e3d-8061-d61c8f81b83b None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:17.452209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84f3d-59c2-4e3d-8061-d61c8f81b83b None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:17.452682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84f3d-59c2-4e3d-8061-d61c8f81b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:17.478197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-b5c84f3d-59c2-4e3d-8061-d61c8f81b83b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:17.479418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-b5c84f3d-59c2-4e3d-8061-d61c8f81b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:17.505697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:17.568232 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:17.592716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e209-5aca-49c0-ac98-9bdbaf592666 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:17.593324 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e209-5aca-49c0-ac98-9bdbaf592666 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:17.593796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e209-5aca-49c0-ac98-9bdbaf592666 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:17.595377 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:17.600711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d737-fb9e-4799-8e28-da4d778f1bba None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:17.600998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d737-fb9e-4799-8e28-da4d778f1bba None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:17.601276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d737-fb9e-4799-8e28-da4d778f1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:17.623361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-f100d737-fb9e-4799-8e28-da4d778f1bba None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:17.624555 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-f100d737-fb9e-4799-8e28-da4d778f1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:17.707338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:17.843422 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f7c3-86e2-415c-b6ad-f5dd0c4076bf None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:17.844102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f7c3-86e2-415c-b6ad-f5dd0c4076bf None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:17.844578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f7c3-86e2-415c-b6ad-f5dd0c4076bf None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:17.846147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 13/26] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:17.851599 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35c6c-72c2-4ecd-aa71-81b436dc1157 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:17.852154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35c6c-72c2-4ecd-aa71-81b436dc1157 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:17.852643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35c6c-72c2-4ecd-aa71-81b436dc1157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:17.881958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-19d35c6c-72c2-4ecd-aa71-81b436dc1157 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:17.883498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-19d35c6c-72c2-4ecd-aa71-81b436dc1157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:17.902034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f7c3-86e2-415c-b6ad-f5dd0c4076bf None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:17.969355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:18.112830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f7c3-86e2-415c-b6ad-f5dd0c4076bf None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:18.140105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:18.141701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b931f4-2851-435a-9f04-5fe3f98062fa None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.142246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b931f4-2851-435a-9f04-5fe3f98062fa None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.142722 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b931f4-2851-435a-9f04-5fe3f98062fa None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.144197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 15/28] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:18.145094 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b931f4-2851-435a-9f04-5fe3f98062fa None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:18.161413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:18.162348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.162765 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.163595 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.176279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:18.178466 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:18.180251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-144c624a-7db4-4157-9367-53d21a994708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:58:18.195063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:18.208996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.209794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.219344 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:18.220918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:18.344829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 15/30] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:18.345901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:18.353599 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b931f4-2851-435a-9f04-5fe3f98062fa None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:18.384903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:18.413992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:18.415000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.415425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.416245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.417515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:18.419839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:18.532927 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400756-d414-45ea-be7b-dfb76b613bf9 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:18.602063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:18.602745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.603028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.603296 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.604046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:18.604350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:18.605815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:18.625246 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 16/31] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:18.626262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:18.664522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 16/32] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Aug 12 10:58:18 2022] POST /identity/v3/roles => generated 219 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:18.666599 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:18.744415 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:18.772327 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f233-36ae-45f6-8992-461a57f1a24e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:18.811701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:18.812583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.813000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.813417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.828425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:18.830256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:18.836452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:18.837452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:18.838434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:18.840515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 17/33] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:18.841536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:18.875220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb2087-73c0-487e-9783-7bd4383914f7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:18.921328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:18.922256 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:18.922689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:18.923121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:18.923774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:18.925358 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:18.972938 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48bbbf-3400-49e4-98cf-1c7a62ac57e8 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.011854 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f183ee7-0704-487c-9be7-75ad25e64451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.013069 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f183ee7-0704-487c-9be7-75ad25e64451 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.013349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f183ee7-0704-487c-9be7-75ad25e64451 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.013623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f183ee7-0704-487c-9be7-75ad25e64451 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.014407 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f183ee7-0704-487c-9be7-75ad25e64451 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.015784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f183ee7-0704-487c-9be7-75ad25e64451 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:19.021862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:19.043172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 17/34] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 10:58:18 2022] POST /identity/v3/projects => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:19.044168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.166857 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa12020-af88-4894-8557-e3bc67c4296e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.196745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:19.205316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.206018 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.206330 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.207176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.207274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:19.207617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.209070 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:19.209606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 18/35] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Aug 12 10:58:18 2022] POST /identity/v3/roles => generated 225 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:19.211150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f0178-a423-44f1-a39d-1b058dc8b783 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.211440 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f0178-a423-44f1-a39d-1b058dc8b783 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.211715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f0178-a423-44f1-a39d-1b058dc8b783 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.213149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:19.219269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5ba5f-7536-4030-986a-c7624ab947d5 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.219726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5ba5f-7536-4030-986a-c7624ab947d5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.219929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5ba5f-7536-4030-986a-c7624ab947d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.228032 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 18/37] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:19.238054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.248622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-fee5ba5f-7536-4030-986a-c7624ab947d5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:19.250378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-fee5ba5f-7536-4030-986a-c7624ab947d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:19.365795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 20/38] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:19.368041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c53a-72b7-4ba9-90bd-85a65c3b8f35 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.368568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c53a-72b7-4ba9-90bd-85a65c3b8f35 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.368917 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c53a-72b7-4ba9-90bd-85a65c3b8f35 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.371893 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 21/39] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:19.378372 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.378658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.384447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.396151 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a3eec-7f22-4cae-b59e-857a5d590d19 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.398799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:19.400302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:19.446899 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.450044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.450044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.450044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.452279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.454651 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:19.457076 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 19/40] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:19 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:19.461851 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.482418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 22/41] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:19.530619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:19.573516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5baf-22e5-4ebf-b964-8b102e7ef5a2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.608236 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.608872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.609159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.609444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.610609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.612073 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:19.613825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 20/42] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:19.619307 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.645327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.678704 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:19.726251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f37b1b-d4ee-471a-8fa7-74eed7dc1e7f None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.747735 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e875ede-a5fc-4611-8edf-22e29b6b055a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.762488 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.763177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.763423 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.763698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] PATH_INFO: `/v3/domains/default/users/4eef8c08fd624006b0498b56eda3d377/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.765593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4eef8c08fd624006b0498b56eda3d377, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.767208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:19.774052 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:19.783357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.783971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.790320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.790320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.790320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.790320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:19.869102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1361 bytes} [Fri Aug 12 10:58:19 2022] PUT /identity/v3/domains/default/users/4eef8c08fd624006b0498b56eda3d377/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:19.869944 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.900171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 21/44] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Aug 12 10:58:19 2022] POST /identity/v3/roles => generated 223 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:58:19.989668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938793-0560-4afc-a8e0-8eb35d63d6ab None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:20.009230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:20.035188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab92dc-20cb-4eaa-bc6e-c47143bf399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:20.035861 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab92dc-20cb-4eaa-bc6e-c47143bf399f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:20.036153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab92dc-20cb-4eaa-bc6e-c47143bf399f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:20.036424 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab92dc-20cb-4eaa-bc6e-c47143bf399f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:20.037686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab92dc-20cb-4eaa-bc6e-c47143bf399f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:20.039226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab92dc-20cb-4eaa-bc6e-c47143bf399f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:20.041127 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 24/45] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:20.047299 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:20.154622 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795591d-8a95-4f5e-9e45-0cd3eef8b5a2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:20.188170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c91fc6-8d33-44c3-b0a6-bd1e5f1c078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:20.188779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91fc6-8d33-44c3-b0a6-bd1e5f1c078e None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:20.189059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91fc6-8d33-44c3-b0a6-bd1e5f1c078e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:20.189329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91fc6-8d33-44c3-b0a6-bd1e5f1c078e None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:20.189998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c91fc6-8d33-44c3-b0a6-bd1e5f1c078e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:20.191427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c91fc6-8d33-44c3-b0a6-bd1e5f1c078e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:20.289081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 22/46] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 10:58:20 2022] POST /identity/v3/projects => generated 312 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:21.768697 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0502-cb47-4be7-ad1f-bff1af8a1bdc None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:21.769191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0502-cb47-4be7-ad1f-bff1af8a1bdc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:21.769272 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0502-cb47-4be7-ad1f-bff1af8a1bdc None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:21.770614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 25/47] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:21.775812 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b1bf-9e34-466c-836c-e3ed2c08e74b None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:21.776204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b1bf-9e34-466c-836c-e3ed2c08e74b None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:21.776374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b1bf-9e34-466c-836c-e3ed2c08e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:21.794598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-4a63b1bf-9e34-466c-836c-e3ed2c08e74b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:21.796109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-4a63b1bf-9e34-466c-836c-e3ed2c08e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:21.826243 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:21.862540 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:22.134245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0502-cb47-4be7-ad1f-bff1af8a1bdc None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.203142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f80f2-e38f-4501-9021-b035fd40fdb6 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.203549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f80f2-e38f-4501-9021-b035fd40fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.203943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f80f2-e38f-4501-9021-b035fd40fdb6 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.205324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 24/49] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:22.210271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.210560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.210831 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.229107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:22.230314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:22.238173 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0502-cb47-4be7-ad1f-bff1af8a1bdc None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.271649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.272282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.272564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.272837 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.283676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:22.288761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:22.289614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:22.290554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 26/50] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:22.296555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.297634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 25/51] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:22.341075 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:22.393450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa3ba-4ba8-425c-bd68-ab7098a0a028 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.425172 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.425779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.426093 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.426374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.427040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:22.427343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:22.428808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:22.443741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 27/52] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:22.449385 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.544236 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:22.548113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90055-8d86-4653-b754-165ad78eb3d1 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.565668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.582075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.582704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.582984 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.583257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.584377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:22.585807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:22.587405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:22 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:22.593055 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.665090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61189d8c-beab-41c4-a0bf-0d7bc9406f25 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.673179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:22.691880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01982-7dfe-4db1-8433-20a9d47f53c6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.701578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.702256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.702551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.702832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.703988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:22.705460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:22.707066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 28/54] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:22.712586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.725052 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.725677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.725991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.726263 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.727382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:22.728822 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:22.731305 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:22.736425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:22.768461 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:22.810748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c3596-9888-43f4-a5de-dc58b0ea830f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.832953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20dfb2-c902-4fa7-8e61-518b2616fd67 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:22.845890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ab3ce-9bdf-4e71-a41d-722647411944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.846527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ab3ce-9bdf-4e71-a41d-722647411944 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.846809 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ab3ce-9bdf-4e71-a41d-722647411944 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.847091 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ab3ce-9bdf-4e71-a41d-722647411944 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.847733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ab3ce-9bdf-4e71-a41d-722647411944 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:22.849175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ab3ce-9bdf-4e71-a41d-722647411944 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:22.866472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:22.867081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:22.867361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:22.867633 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:22.868350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.domain.id=default, user.id=4eef8c08fd624006b0498b56eda3d377) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:22.868656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:22.870121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757acb9-7748-487d-b87e-49857734d831 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:22.876352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 28/56] 10.222.0.40 () {56 vars in 1322 bytes} [Fri Aug 12 10:58:22 2022] GET /identity/v3/role_assignments?user.id=4eef8c08fd624006b0498b56eda3d377&scope.domain.id=default&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:22.946117 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 29/57] 10.222.0.40 () {60 vars in 1140 bytes} [Fri Aug 12 10:58:22 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:58:24.854892 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744bf63-1f7d-4aac-9335-8b16bf7dfca1 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:24.855901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744bf63-1f7d-4aac-9335-8b16bf7dfca1 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:24.856012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744bf63-1f7d-4aac-9335-8b16bf7dfca1 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:24.857423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 29/58] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:24.862664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:24.863067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:24.863224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:24.882023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:24.883223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:24.905110 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:24.950515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 30/59] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:25.221627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744bf63-1f7d-4aac-9335-8b16bf7dfca1 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:25.317376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:25.321971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744bf63-1f7d-4aac-9335-8b16bf7dfca1 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:25.354611 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf4302-13ab-4894-8a6a-1e7c32174afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:25.355286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4302-13ab-4894-8a6a-1e7c32174afe None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:25.355709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4302-13ab-4894-8a6a-1e7c32174afe None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:25.355987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4302-13ab-4894-8a6a-1e7c32174afe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:25.357108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf4302-13ab-4894-8a6a-1e7c32174afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:25.358594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf4302-13ab-4894-8a6a-1e7c32174afe None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:25.360197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 30/60] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:25.365735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:25.465419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f6e9-d88a-4aaa-9643-f73b45e16771 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:25.498575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec65b0-1de1-4501-8555-9e155ad44168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:25.499127 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec65b0-1de1-4501-8555-9e155ad44168 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:25.499411 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec65b0-1de1-4501-8555-9e155ad44168 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:25.499686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec65b0-1de1-4501-8555-9e155ad44168 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:25.500339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec65b0-1de1-4501-8555-9e155ad44168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:25.501785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec65b0-1de1-4501-8555-9e155ad44168 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:25.618257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 31/61] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:25 2022] POST /identity/v3/users => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:28.648050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdebcbb-3ed9-405a-bcaf-ec648af8fdc0 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:28.649026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdebcbb-3ed9-405a-bcaf-ec648af8fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:28.649500 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdebcbb-3ed9-405a-bcaf-ec648af8fdc0 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:28.651091 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 31/62] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:28.656969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500e5c-ba1b-4b2b-b3e1-e4dd890a0c15 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:28.657748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500e5c-ba1b-4b2b-b3e1-e4dd890a0c15 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:28.658241 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500e5c-ba1b-4b2b-b3e1-e4dd890a0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:28.687098 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-1a500e5c-ba1b-4b2b-b3e1-e4dd890a0c15 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:28.688570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-1a500e5c-ba1b-4b2b-b3e1-e4dd890a0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:28.697151 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:28.771273 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 32/63] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:28.794278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3319b0-9d5e-425e-81b7-cc57105d528f None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:28.794570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3319b0-9d5e-425e-81b7-cc57105d528f None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:28.794833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3319b0-9d5e-425e-81b7-cc57105d528f None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:28.796191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 32/64] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:28.814465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf76ad-0f99-4b1e-88ba-c583c47b30e5 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:28.814755 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf76ad-0f99-4b1e-88ba-c583c47b30e5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:28.815043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf76ad-0f99-4b1e-88ba-c583c47b30e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:28.842962 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-6cbf76ad-0f99-4b1e-88ba-c583c47b30e5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:28.844147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-6cbf76ad-0f99-4b1e-88ba-c583c47b30e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:28.957209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94732-3cab-4993-9433-a8ed6b661de7 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:28.957863 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94732-3cab-4993-9433-a8ed6b661de7 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:28.958384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94732-3cab-4993-9433-a8ed6b661de7 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:28.959947 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 33/65] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:28.965769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:28.966315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:28.966849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:28.973973 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 33/66] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:28.993979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:28.995376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:29.075177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035588-dd3b-4373-bb19-918ed7ba3460 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.075803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035588-dd3b-4373-bb19-918ed7ba3460 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.076353 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035588-dd3b-4373-bb19-918ed7ba3460 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.077910 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 34/67] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:29.083436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.083964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.084476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.098248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 34/68] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:29.111511 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:29.112703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:29.117204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.240868 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 35/69] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:29.297266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.303187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fdcfb-b179-4aa5-8323-1dba62bbd1af None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.333717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.336846 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.355994 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.356694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.356983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.357258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.377455 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:29.382250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:29.383065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:29.383800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 35/70] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:29.389934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.481017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99fafb-99dd-465c-bea3-a4f4e90b021b None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.511333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d07ac-3c05-484f-9dfc-2cdd61cb6ead None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.515908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbda08-2b4e-4e85-99ae-bdeb67e1c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.516549 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbda08-2b4e-4e85-99ae-bdeb67e1c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.516834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbda08-2b4e-4e85-99ae-bdeb67e1c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.517111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbda08-2b4e-4e85-99ae-bdeb67e1c4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.527918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbda08-2b4e-4e85-99ae-bdeb67e1c4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-48fbda08-2b4e-4e85-99ae-bdeb67e1c4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:29.532632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:29.533586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:29.534358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 36/71] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:58:29.536345 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a54e-ee41-415b-99ba-234ce0434ead None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.536645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a54e-ee41-415b-99ba-234ce0434ead None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.536922 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a54e-ee41-415b-99ba-234ce0434ead None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.538302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 37/72] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:29.539216 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a54e-ee41-415b-99ba-234ce0434ead None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.554013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.554713 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.555069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.555415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.556184 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:29.556562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:29.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:29.570082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:29.570082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.590394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.607350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.646354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a54e-ee41-415b-99ba-234ce0434ead None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.669671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094e3c-9c8b-484d-a82d-5cef3b538f31 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.682205 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a881fe9-1d70-44b5-b648-642df543b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.682847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a881fe9-1d70-44b5-b648-642df543b855 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.683135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a881fe9-1d70-44b5-b648-642df543b855 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.683417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a881fe9-1d70-44b5-b648-642df543b855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.693719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a881fe9-1d70-44b5-b648-642df543b855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-9a881fe9-1d70-44b5-b648-642df543b855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:29.698436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:29.700156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:29.701106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 38/74] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:29.703162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.703258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.703461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.703772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.703914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.704117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.704396 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.705294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:29.705451 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:29.706766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:29.715657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:29.716866 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.721973 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:29.723168 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:29.791944 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 39/76] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:29.794792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.797280 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.816458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9fb3c-981f-4aa9-b52c-cf8010a997a5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.850280 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.854413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.855011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.855327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.855694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.871790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:29.873248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:29.879732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 38/77] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:29.879732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.907086 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9891-baf5-4362-b8d7-87311761e900 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:29.944016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:29.944647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:29.944930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:29.945201 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:29.956010 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:29.961060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:29.961909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:29.962691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 40/78] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:29.963306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:29.994849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ee45-864f-4b5c-8dfb-64c26db0e1d0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.031305 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.031925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.032212 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.032490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.033160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:30.033474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.034880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.040430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.045345 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 39/79] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.045942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.071895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b449d1f-d102-4398-8962-d2ea84db7426 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.085470 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.107046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.108001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.108339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.108616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.109792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.111294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.112874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 41/80] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:29 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.114782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.148145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cc745-e198-4d74-a5ca-130587035a99 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.181559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.182211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.182497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.182776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.213687 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c304f-2b20-4612-b1d4-69e13b0e5911 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.246547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.247148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.247429 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.247732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.248065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.248397 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:30.248702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.250127 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.250357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.251806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.258134 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 42/81] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.258804 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.302693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.348940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 40/82] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:30.350023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.358332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf8879-84dc-4720-9a58-5bfc042e5130 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.391044 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.391673 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.391953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.392224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.393356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.394826 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.396382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 43/83] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.397134 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.455422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.458196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239c45b-49fa-4fd1-8e4d-b55a42fb7b4b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.492482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.493820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.494133 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.494411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.495358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239f2f-b455-4b78-bc4b-96e4f2b93d8d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.495529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.497510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.500010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 41/84] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.500010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.507362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.530672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.531285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.531616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.531894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.598407 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.599782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a44b2-5a6b-4d59-b7ee-8b5ac0eaf411 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.599886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.632332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.632955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.633242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.633521 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.634687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.636118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.638312 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 42/85] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.639789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.673273 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.696904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 44/86] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:30.697757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.709140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.742121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af105c-03d2-4fa3-83f0-cf01294efa8e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.776228 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.776860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.777214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.777710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.778915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.780362 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.782047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 43/87] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:30.782794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:30.794464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2645d0-0b4a-46dc-9f9e-0c64b3d35e96 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.829938 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.830562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.830842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.831109 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.891527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0950-7287-42a7-bbbd-6518ec69a2d4 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:30.893674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.896434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.897965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.908898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.924350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:30.924954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:30.925232 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:30.925501 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:30.926172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:30.927582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:30.997496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 45/88] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:30.998197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.012807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 44/89] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:30 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:31.013645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.123634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03ee5-36d7-497c-8439-79ac4d4483de None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.131064 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09901-3230-46f7-abce-518fbb2170e5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.135677 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:31.161568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.162645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.163035 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.163314 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.173419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.174149 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.174434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.174713 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.176732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.178244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.179941 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 45/90] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:31.180718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.210109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:31.244916 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.246849 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.326196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9af295-4d74-49a7-bd68-8999098012e7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.365605 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.366522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.366979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.370327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.370450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 46/91] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:31.370450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.370579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=acea4156218b49ab9e9c2878ec6bf879) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:31.370662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.372214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.380388 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 46/92] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/role_assignments?user.id=acea4156218b49ab9e9c2878ec6bf879&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:31.382197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.383611 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:31.497819 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c02136-bc19-47cf-902a-a44ef6ec2495 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.520705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:31.532913 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f88d6-661b-4954-82ee-051f3ed5569b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.577947 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.578965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.579476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.579956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.580905 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=4eef8c08fd624006b0498b56eda3d377) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:31.581423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.583288 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.590623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 47/93] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/role_assignments?user.id=4eef8c08fd624006b0498b56eda3d377&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:31.591900 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.592926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.593603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.593885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.594183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.595406 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.596898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.598709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 47/94] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:31.604876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.729452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e54f-bda5-4a77-a9f6-1d12262f085b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.742109 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:31.774917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.776089 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.776579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.777706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] PATH_INFO: `/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.779637 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] RBAC: Authorizing `identity:get_project(project_id=94f2c13f07104f99a0a2e2b0c4560c1f)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.781768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.783771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 48/95] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:31.789707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:31.795929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5c4c2-5b20-475e-936b-f0d6ded2f27d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.821570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:31.892266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.892921 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.893198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.893551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.894234 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] RBAC: Adding query filter params (role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=acea4156218b49ab9e9c2878ec6bf879) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:31.894542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.895998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dba08d-573f-4e07-9405-eebdb17dfdc1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.913475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fb64d-6d98-4646-899c-f4c4ef9d3693 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:31.917324 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 48/96] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/role_assignments?user.id=acea4156218b49ab9e9c2878ec6bf879&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:31.956723 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:31.957719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:31.958244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:31.958750 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:31.959730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=94f2c13f07104f99a0a2e2b0c4560c1f, user.id=acea4156218b49ab9e9c2878ec6bf879) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:31.960276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:31.962200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4891e-d039-496c-823e-979b00711ab2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:31.969269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 49/97] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:31 2022] GET /identity/v3/role_assignments?user.id=acea4156218b49ab9e9c2878ec6bf879&scope.project.id=94f2c13f07104f99a0a2e2b0c4560c1f&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:33.327184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00662-97af-4ddb-b433-c9911aa92562 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:33.327708 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00662-97af-4ddb-b433-c9911aa92562 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:33.327708 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00662-97af-4ddb-b433-c9911aa92562 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:33.329071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 49/98] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:33.339134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251efc09-b132-4e85-8979-edc41617b718 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:33.340553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251efc09-b132-4e85-8979-edc41617b718 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:33.341039 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251efc09-b132-4e85-8979-edc41617b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:33.366953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-251efc09-b132-4e85-8979-edc41617b718 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:33.368535 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-251efc09-b132-4e85-8979-edc41617b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:33.459229 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 50/99] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:33.984230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00662-97af-4ddb-b433-c9911aa92562 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:34.111641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00662-97af-4ddb-b433-c9911aa92562 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:34.149496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630f481-b697-45fe-8262-f948602e575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:34.150538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f481-b697-45fe-8262-f948602e575f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.151066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f481-b697-45fe-8262-f948602e575f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.151539 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f481-b697-45fe-8262-f948602e575f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.162967 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630f481-b697-45fe-8262-f948602e575f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-9630f481-b697-45fe-8262-f948602e575f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:34.168970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:34.169818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:34.170590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:34.172888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 50/100] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:34.178624 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251efc09-b132-4e85-8979-edc41617b718 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:34.201342 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:34.259599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0b48-00ae-40bf-8612-ffa485927974 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.260565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0b48-00ae-40bf-8612-ffa485927974 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.261042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0b48-00ae-40bf-8612-ffa485927974 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.264869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 51/101] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:34.268150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb48f-09a2-4626-942a-1b61f16d6794 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.268715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb48f-09a2-4626-942a-1b61f16d6794 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.269192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb48f-09a2-4626-942a-1b61f16d6794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.276514 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:34.288804 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-68feb48f-09a2-4626-942a-1b61f16d6794 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:34.290028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-68feb48f-09a2-4626-942a-1b61f16d6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:34.427048 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251efc09-b132-4e85-8979-edc41617b718 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:34.505382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:34.506026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.506313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.506594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.507268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:34.507576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:34.508955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c44033-472b-4d25-b37e-62634a2143ff None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:34.521654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 52/102] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:34.522828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a9e2a-e813-473f-ae73-36069333529c None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.523124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a9e2a-e813-473f-ae73-36069333529c None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.523406 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a9e2a-e813-473f-ae73-36069333529c None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.525050 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 53/103] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:34.528895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 51/104] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:34.532465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff092-fc00-4079-ad66-2b868945581c None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.532759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff092-fc00-4079-ad66-2b868945581c None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.533047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff092-fc00-4079-ad66-2b868945581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.535316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68f1a-7895-4d7e-8a6b-d94592efa5bd None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.535611 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68f1a-7895-4d7e-8a6b-d94592efa5bd None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.535889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68f1a-7895-4d7e-8a6b-d94592efa5bd None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.539368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 52/105] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:34.545075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e68f1a-7895-4d7e-8a6b-d94592efa5bd None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:34.573358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-2c0ff092-fc00-4079-ad66-2b868945581c None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:34.575422 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-2c0ff092-fc00-4079-ad66-2b868945581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:34.692177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 54/106] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:34.693463 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271476de-be18-4ec1-b997-eee1765aca2c None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.693759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271476de-be18-4ec1-b997-eee1765aca2c None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.694069 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271476de-be18-4ec1-b997-eee1765aca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.726939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-271476de-be18-4ec1-b997-eee1765aca2c None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:34.728582 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-271476de-be18-4ec1-b997-eee1765aca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:34.750333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:34.766977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e68f1a-7895-4d7e-8a6b-d94592efa5bd None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:34.822356 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f002702-2cae-461e-8b68-4306881b1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:34.822913 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002702-2cae-461e-8b68-4306881b1ccf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.823198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002702-2cae-461e-8b68-4306881b1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.823607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002702-2cae-461e-8b68-4306881b1ccf None admin] PATH_INFO: `/v3/users/718e16568bd549a3acaaa7586bad55de` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.838239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f002702-2cae-461e-8b68-4306881b1ccf None admin] RBAC: Authorizing `identity:get_user(user_id=718e16568bd549a3acaaa7586bad55de)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:34.840523 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f002702-2cae-461e-8b68-4306881b1ccf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:34.842604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 53/107] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:34 2022] GET /identity/v3/users/718e16568bd549a3acaaa7586bad55de => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:34.843651 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b594-a7ef-4e09-bf7b-948e9b0b1c66 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.843937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b594-a7ef-4e09-bf7b-948e9b0b1c66 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.844213 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b594-a7ef-4e09-bf7b-948e9b0b1c66 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.845718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 54/108] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:34.852142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51b594-a7ef-4e09-bf7b-948e9b0b1c66 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:34.881602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:34.893100 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 55/109] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:34.894550 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:34.895001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:34.895436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:34.913527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:34.915119 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:34.963039 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51b594-a7ef-4e09-bf7b-948e9b0b1c66 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:34.990077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 56/110] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:34.991197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.013898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.014825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.015282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.015729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.027881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.106633 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.109146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.115344 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705e924-28fb-48c8-87d5-850783c7fbe9 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.140931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.154182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed272cb-dc77-41c2-a5e1-a0d3c931c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.154832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed272cb-dc77-41c2-a5e1-a0d3c931c343 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.155116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed272cb-dc77-41c2-a5e1-a0d3c931c343 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.155394 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed272cb-dc77-41c2-a5e1-a0d3c931c343 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.170529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed272cb-dc77-41c2-a5e1-a0d3c931c343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-aed272cb-dc77-41c2-a5e1-a0d3c931c343 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:35.176198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:35.177028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:35.177871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:35.178486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 57/111] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:35.182097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8cae0-319f-489e-92f3-9890093c630e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.182097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8cae0-319f-489e-92f3-9890093c630e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.182097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8cae0-319f-489e-92f3-9890093c630e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.185675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 58/112] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:35.185675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8cae0-319f-489e-92f3-9890093c630e None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.238692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 55/113] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:35.239625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.281909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.299941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8cae0-319f-489e-92f3-9890093c630e None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.333908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcbd72-e624-4112-8c7e-bf455df569c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.334580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbd72-e624-4112-8c7e-bf455df569c5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.334864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbd72-e624-4112-8c7e-bf455df569c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.335141 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbd72-e624-4112-8c7e-bf455df569c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.342480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34135e-c78d-4883-9054-247fbc02f175 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.345343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcbd72-e624-4112-8c7e-bf455df569c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e6bcbd72-e624-4112-8c7e-bf455df569c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:35.350040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:35.350974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:35.351722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 59/114] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:35.355686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.356040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.356357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.373379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:35.374507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:35.377547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.378241 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.378532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.378807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.379472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:35.379778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.381138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.389620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 56/115] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:35.390441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.414019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.445529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 60/116] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:35.446600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.496256 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.499224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c395-572f-4f71-901e-343fbccc436c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.533937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.534574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.534855 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.535133 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.536261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.537707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.539305 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 57/117] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:35.540069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.557076 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6de97-f772-49a6-a680-9da06d199a94 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.593180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.593904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.594117 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.594394 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.595527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.597174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.598624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 61/118] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:35.603495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.643911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.650997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60ea6-11b4-4464-a8ee-5ba3efba9093 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.687545 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.688229 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.688506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.688829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.702414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:35.703861 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c107-bcc4-4395-853e-4727afca225a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:35.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:35.708369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:35.709111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 58/119] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:35.709819 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.740875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.741537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.741828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.742134 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.742709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.742810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:35.743086 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.744462 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.753289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 62/120] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:35.753909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.815898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec5afe-d86a-4438-8ef1-fec665e49101 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.848667 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.849292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.849577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.849854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.850897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5d29-ced9-4c12-936f-6e452ecc3854 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.851037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.852503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.852599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.854125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 59/121] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:35.854915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.889862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.890513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.890798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.891091 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.891797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.893793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:35.948591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:35.954275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98980908-344e-43b3-b7cd-e7a0bf3ea5fc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:35.961881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 63/122] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 10:58:35 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:35.964896 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:35.994659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:35.995290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:35.995656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:35.995987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:35.996746 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] RBAC: Adding query filter params (role.id=de00389d088a488ab9ebd2e4984b644a, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=718e16568bd549a3acaaa7586bad55de) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:35.997063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:35.998570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.004609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 60/123] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/role_assignments?user.id=718e16568bd549a3acaaa7586bad55de&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=de00389d088a488ab9ebd2e4984b644a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.005269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.098648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2486a-2dfc-40e6-acf9-5a44c022920d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.143113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.143444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.143664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.143937 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.144658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:36.144964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.146445 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.156459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 64/124] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:58:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.157409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.166622 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fd461-2dd6-44b7-aa34-ac33daf0c7d4 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.180847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:36.213387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.213969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.214279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.214619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.226288 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:36.232301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:36.233351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 61/125] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:36.234251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.257726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:36.279752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eac8b-2889-45cc-8f52-af6b18fc07dc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.318888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.319863 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.320275 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.320688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.322121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.324492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.326721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 65/126] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.327780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.339319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6949-59eb-4ece-8cdd-a3f86142b2df None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.375141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.375959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.376338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.376707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.378016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.379619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.381369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 62/127] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.382252 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.430321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:36.449959 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ff6eb-3d84-46d3-8af0-bebc6edddac0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.483159 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.484040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.484732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.485015 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.486468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.488369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.489957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 66/128] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.490731 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.490835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:36.510687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b766d-203a-47cd-948e-3562086b991f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.556215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.557296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.557580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.557856 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.560057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:36.560380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.562081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.573875 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 63/129] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.574885 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.624586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1962f37-75bd-4447-acd5-575c1a46b9db None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.661172 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.663505 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.663892 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.664181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.666816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.669194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.671146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 67/130] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.677240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.706157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322372c-fc4a-42ff-995a-e9ebfebce6eb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.708139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:36.755189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.756239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.757136 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.757577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/acea4156218b49ab9e9c2878ec6bf879/roles/e724fe5c79a448c48fa8cdbb118400fe` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.760279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=0a98ceb5527d476588ffaa7358e80a99, user_id=acea4156218b49ab9e9c2878ec6bf879, role_id=e724fe5c79a448c48fa8cdbb118400fe)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.762796 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.794148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d14bb-7422-44f6-b8a5-93c1dda946db None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:36.820397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 64/131] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:36 2022] PUT /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/acea4156218b49ab9e9c2878ec6bf879/roles/e724fe5c79a448c48fa8cdbb118400fe => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:36.821483 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.838346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:36.844132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:36.845126 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:36.845384 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:36.845721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:36.849039 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:36.850592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:36.857979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 68/132] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:36.857979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:36.960831 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255276e-259a-462f-8f25-50813d6e7c6f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:37.005294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:37.006335 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:37.006811 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:37.007289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:37.008705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:37.011572 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:37.013673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 65/133] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:36 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:37.014739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:37.041309 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:37.070003 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ad73-27b6-4132-8d61-17dd19fd7781 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:37.114685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:37.141881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:37.142625 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:37.142916 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:37.144170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/4eef8c08fd624006b0498b56eda3d377/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:37.145395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd94e-1212-4a81-ba99-984ed8d3498a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:37.146933 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] RBAC: Authorizing `identity:create_grant(project_id=0a98ceb5527d476588ffaa7358e80a99, user_id=4eef8c08fd624006b0498b56eda3d377, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:37.149404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:37.188657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:37.189594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:37.189878 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:37.190187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/acea4156218b49ab9e9c2878ec6bf879/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:37.192498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a98ceb5527d476588ffaa7358e80a99, user_id=acea4156218b49ab9e9c2878ec6bf879, role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:37.194085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:37.220027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 69/134] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:36 2022] PUT /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/4eef8c08fd624006b0498b56eda3d377/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:37.221433 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:37.271722 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 66/135] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:37 2022] PUT /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/acea4156218b49ab9e9c2878ec6bf879/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:37.359271 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea556-35ef-43f5-b11d-317c78cdffec None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:37.398078 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aca23b-818e-4a29-abab-0ef33f103d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:37.399103 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca23b-818e-4a29-abab-0ef33f103d03 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:37.399608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca23b-818e-4a29-abab-0ef33f103d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:37.400098 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca23b-818e-4a29-abab-0ef33f103d03 None admin] PATH_INFO: `/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:37.401512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aca23b-818e-4a29-abab-0ef33f103d03 None admin] RBAC: Authorizing `identity:get_project(project_id=94f2c13f07104f99a0a2e2b0c4560c1f)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:37.403932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aca23b-818e-4a29-abab-0ef33f103d03 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:37.405964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 70/136] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:37 2022] GET /identity/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:37.412337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:37.546426 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70b6bb-6175-48bb-944f-5c3b46529766 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:37.584906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196032f9-abdf-49b9-a098-1945d45ebde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:37.585584 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196032f9-abdf-49b9-a098-1945d45ebde2 None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:37.585859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196032f9-abdf-49b9-a098-1945d45ebde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:37.586166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196032f9-abdf-49b9-a098-1945d45ebde2 None admin] PATH_INFO: `/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f/users/acea4156218b49ab9e9c2878ec6bf879/roles/e724fe5c79a448c48fa8cdbb118400fe` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:37.588167 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196032f9-abdf-49b9-a098-1945d45ebde2 None admin] RBAC: Authorizing `identity:create_grant(project_id=94f2c13f07104f99a0a2e2b0c4560c1f, user_id=acea4156218b49ab9e9c2878ec6bf879, role_id=e724fe5c79a448c48fa8cdbb118400fe)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:37.589658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196032f9-abdf-49b9-a098-1945d45ebde2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:37.665493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:37.671197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 67/137] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:37 2022] PUT /identity/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f/users/acea4156218b49ab9e9c2878ec6bf879/roles/e724fe5c79a448c48fa8cdbb118400fe => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:38.205550 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba27d-f33a-4d5f-b0db-1ad5e23673fc None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:38.206646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba27d-f33a-4d5f-b0db-1ad5e23673fc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:38.207137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba27d-f33a-4d5f-b0db-1ad5e23673fc None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:38.208709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 71/138] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:38.214906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:38.215267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:38.215452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:38.242619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:38.243829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:38.287708 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a520b-dc81-4e61-b70c-b1958422481a None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:38.288347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a520b-dc81-4e61-b70c-b1958422481a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:38.289046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a520b-dc81-4e61-b70c-b1958422481a None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:38.295295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 72/139] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:38.296799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:38.297288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:38.297785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:38.334957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:38.336529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:38.339903 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 68/140] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:38.350268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:38.444814 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 73/141] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:38.678634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:38.794211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c707e-184a-4049-8a09-d5230bdf46c8 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:38.826321 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:38.833786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:38.834449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:38.834732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:38.835021 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:38.850833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:38.856050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:38.856865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:38.857628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:38.862354 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 69/142] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:38.871776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:38.981131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:39.030779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f2e2-d9a1-44eb-8d21-59eec5c3eb40 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:39.098332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:39.098971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:39.099256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:39.099529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:39.100205 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:39.100514 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:39.101902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:39.115909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 74/143] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:39.124180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:39.152793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:39.170183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43ee8e-6bf7-486e-ad70-73553cf8812c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:39.244828 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:39.245421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:39.246990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:39.247275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:39.248992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:39.250805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:39.252446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 70/144] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:39.260521 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:39.332598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278eedf-36df-422b-9a6c-17290ba0534b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:39.360961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:39.399550 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:39.400200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:39.400486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:39.400762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] PATH_INFO: `/v3/users/718e16568bd549a3acaaa7586bad55de` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:39.406699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] RBAC: Authorizing `identity:get_user(user_id=718e16568bd549a3acaaa7586bad55de)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:39.408196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:39.410009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 75/145] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:39 2022] GET /identity/v3/users/718e16568bd549a3acaaa7586bad55de => generated 289 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:39.422930 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143a15-0552-4efa-9196-c23c16ddddcc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:39.431185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:39.487396 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:39.488012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:39.488296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:39.488573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:39.489231 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:39.490726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:39.557500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:39.590651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6bce1-e993-411e-8867-fc471f1269e0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:39.631118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 71/146] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:39 2022] POST /identity/v3/users => generated 283 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:58:39.637876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7933042-5b3e-4e20-bcb6-c2148092919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:39.638561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7933042-5b3e-4e20-bcb6-c2148092919b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:39.638843 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7933042-5b3e-4e20-bcb6-c2148092919b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:39.639117 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7933042-5b3e-4e20-bcb6-c2148092919b None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:39.640362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7933042-5b3e-4e20-bcb6-c2148092919b None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:39.641888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7933042-5b3e-4e20-bcb6-c2148092919b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:39.643996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 76/147] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:39 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:39.650595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:39.830820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37960fd9-84ce-4343-b8eb-8cfd942bf2aa None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:39.857724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:39.887894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0edd6e-41d4-4317-bdae-d0f27184ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:39.888594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edd6e-41d4-4317-bdae-d0f27184ed7a None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:39.888884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edd6e-41d4-4317-bdae-d0f27184ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:39.889169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edd6e-41d4-4317-bdae-d0f27184ed7a None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/718e16568bd549a3acaaa7586bad55de/roles/de00389d088a488ab9ebd2e4984b644a` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:39.891193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0edd6e-41d4-4317-bdae-d0f27184ed7a None admin] RBAC: Authorizing `identity:create_grant(project_id=0a98ceb5527d476588ffaa7358e80a99, user_id=718e16568bd549a3acaaa7586bad55de, role_id=de00389d088a488ab9ebd2e4984b644a)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:39.893019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0edd6e-41d4-4317-bdae-d0f27184ed7a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:39.968284 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 72/148] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:39 2022] PUT /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99/users/718e16568bd549a3acaaa7586bad55de/roles/de00389d088a488ab9ebd2e4984b644a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:40.220023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a86d4-1eab-4a69-bd65-dc4db153030e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.220357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a86d4-1eab-4a69-bd65-dc4db153030e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.220549 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a86d4-1eab-4a69-bd65-dc4db153030e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.221877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 77/149] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:40.229620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4570-b63e-4dc4-9cc6-faf749dd2763 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.229620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4570-b63e-4dc4-9cc6-faf749dd2763 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.229620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4570-b63e-4dc4-9cc6-faf749dd2763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.251265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-0a0c4570-b63e-4dc4-9cc6-faf749dd2763 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:40.252761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-0a0c4570-b63e-4dc4-9cc6-faf749dd2763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:40.312530 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49199-e0fe-4de8-96f8-a007ab223a24 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.313220 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49199-e0fe-4de8-96f8-a007ab223a24 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.313677 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49199-e0fe-4de8-96f8-a007ab223a24 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.315276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 78/150] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:40.320935 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2bd7-5d0d-461f-96cc-713f37e16dad None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.321235 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2bd7-5d0d-461f-96cc-713f37e16dad None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.321509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2bd7-5d0d-461f-96cc-713f37e16dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.345654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 73/151] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:40.347095 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76142460-92d9-47ed-b30e-99e32a51059b None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.347369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-972a2bd7-5d0d-461f-96cc-713f37e16dad None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:40.347776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76142460-92d9-47ed-b30e-99e32a51059b None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.347776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76142460-92d9-47ed-b30e-99e32a51059b None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.348566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-972a2bd7-5d0d-461f-96cc-713f37e16dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:40.349112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 74/152] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:40.356510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.356794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.357132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.380483 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:40.382204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:40.442473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 79/153] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:40.443972 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f44a6-d375-4d98-be1b-37cc0e82b269 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.444454 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f44a6-d375-4d98-be1b-37cc0e82b269 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.445129 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f44a6-d375-4d98-be1b-37cc0e82b269 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.446776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 80/154] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:40.459905 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.460256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.460655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:40.469843 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 75/155] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:40.495047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:40.496861 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:40.583290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 81/156] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:40.765664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:40.804601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:40.806677 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:40.812671 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:40.931709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a185-efbb-4b84-8e5f-e84686c81ea4 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:40.984782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110c81f-0e68-4785-ab46-18124c51e459 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:40.994122 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:40.994760 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:40.995038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:40.995815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.015889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:41.020613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:41.021423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:41.022198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 76/157] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:41.027360 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.036402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.037057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.037337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.037607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.053825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:41.060736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:41.061827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:41.062773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 82/158] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:41.063569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.145396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.166439 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.181249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be616-72d7-4b81-8cf5-f27a806e4f97 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.204357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae416-b98b-44ca-b8b5-ce99e1c69d7f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.223411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.224058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.224433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.224661 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.238759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:41.246497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:41.247492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:41.248255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 77/159] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:41.249348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.249455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.254751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.254751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.254751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.265023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:41.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:41.272912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:41.273770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:41.274401 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 83/160] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:41.274783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.392444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dcf75-8615-4fea-b29c-28b5f6de201a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.434714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.434714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.434714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.434714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.435346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:41.435656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:41.437057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:41.439809 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b78a0-fab6-4543-989b-3343c2459d7b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.449094 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 78/161] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:41.449094 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.467321 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.500509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.523531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.524071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.524413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.524691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.525408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:41.525794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:41.527849 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:41.547998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 84/162] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:41.550260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.629150 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6060-089f-4856-8fbb-3d7985daa0f2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.665809 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.666711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.666994 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.667469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.668182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:41.668490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:41.669884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:41.678479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 79/163] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:41.679442 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.756463 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f446-8875-4816-bc0f-47faa77c775e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.760099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.818555 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85c2f6-9557-440c-9892-0ebc518844c3 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.824718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.825496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.825865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.826283 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.826621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.827248 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.827524 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.827792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.827979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:41.828460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:41.828759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:41.829817 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:41.830135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:41.831617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 80/164] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:41.832563 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.844570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 85/165] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:41.845420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:41.916334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.941369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe879f-9d35-46b7-91ac-736185f823f5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:41.980586 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:41.981289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:41.981571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:41.981868 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] PATH_INFO: `/v3/users/4eef8c08fd624006b0498b56eda3d377` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:41.983823 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] RBAC: Authorizing `identity:get_user(user_id=4eef8c08fd624006b0498b56eda3d377)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:41.985285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:41.987074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 81/166] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/users/4eef8c08fd624006b0498b56eda3d377 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:41.989019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:42.000049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f7a7-8f88-4db5-a54a-494039f1badc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:42.022266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:42.074091 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:42.074793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:42.075080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:42.075354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:42.076994 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:42.078480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:42.080241 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 86/167] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:42.085048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:42.194849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16d2d-a141-461a-b0a5-4c4ad609a89c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:42.266477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:42.267098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:42.267380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:42.267649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:42.295043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee38d0-77ba-4135-a118-0639b2190e22 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:42.315214 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:42.340902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:42.342369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:42.355096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:42.355822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:42.356102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:42.356375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] PATH_INFO: `/v3/users/acea4156218b49ab9e9c2878ec6bf879` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:42.357552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] RBAC: Authorizing `identity:get_user(user_id=acea4156218b49ab9e9c2878ec6bf879)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:42.359036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:42.360908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 87/168] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:42 2022] GET /identity/v3/users/acea4156218b49ab9e9c2878ec6bf879 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:42.361674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:42.366250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:42.490747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d0c0-dec2-44cd-887b-baa894140030 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:42.527956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:42.528932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:42.529426 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:42.529896 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:42.534585 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 82/169] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:42.535547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:42.586921 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:42.611283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:42.611283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:42.709372 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 88/170] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:42.710620 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:42.744097 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67cc95-3f10-428e-80ef-7a9fd4b5ba38 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:42.779920 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:42.817149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:42.825349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2ff9-25c0-4b76-983c-c9b5c50cbe36 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:42.861868 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:42.862947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:42.863428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:42.863884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:42.871864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:42.872498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:42.872774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:42.873043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:42.942612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:42.944840 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:42.999681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.001088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.040878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.061532 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 89/171] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:43.062834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.174920 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2c84e-1da4-4785-a845-b2683cf55b77 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.189098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 83/172] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:43.193533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.217434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.225723 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b6a3-ff7a-4e80-9a47-cc599a69e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.229688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b6a3-ff7a-4e80-9a47-cc599a69e325 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.230370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b6a3-ff7a-4e80-9a47-cc599a69e325 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.230807 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b6a3-ff7a-4e80-9a47-cc599a69e325 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.233235 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b6a3-ff7a-4e80-9a47-cc599a69e325 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.235364 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b6a3-ff7a-4e80-9a47-cc599a69e325 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.242627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 90/173] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.243678 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24883982-15e7-41aa-b28d-67c1e8cf56a2 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.244996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24883982-15e7-41aa-b28d-67c1e8cf56a2 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.246128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24883982-15e7-41aa-b28d-67c1e8cf56a2 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.247568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 91/174] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:43.250603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24883982-15e7-41aa-b28d-67c1e8cf56a2 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.342801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.372748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ebf3-8614-49a5-afdd-8b064a97f790 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.418627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24883982-15e7-41aa-b28d-67c1e8cf56a2 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.423198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.424082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.424566 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.425079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.427018 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.428829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.430668 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 84/175] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.431506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.463822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.465341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.465745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.466213 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.469965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.469965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.471270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 92/176] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.471953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.536263 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.559371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f931cd-9e6d-4a6e-b43b-8eda12bccf3f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.585297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a064c-a3ae-4c2c-841b-533370f40645 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.595685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be429aa-a2fa-465d-b062-3309b3917d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.596290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be429aa-a2fa-465d-b062-3309b3917d8a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.596568 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be429aa-a2fa-465d-b062-3309b3917d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.596835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be429aa-a2fa-465d-b062-3309b3917d8a None admin] PATH_INFO: `/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.598069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be429aa-a2fa-465d-b062-3309b3917d8a None admin] RBAC: Authorizing `identity:get_project(project_id=94f2c13f07104f99a0a2e2b0c4560c1f)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.599426 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be429aa-a2fa-465d-b062-3309b3917d8a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.601184 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 85/177] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/projects/94f2c13f07104f99a0a2e2b0c4560c1f => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.602435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.602645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.602915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.610183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.621894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:43.623120 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:43.626219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.627026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.627474 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.627927 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.628882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=acea4156218b49ab9e9c2878ec6bf879) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:43.629359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.631165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc8535-ff30-4048-a224-98e81e4d60d7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.638457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 93/178] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/role_assignments?user.id=acea4156218b49ab9e9c2878ec6bf879&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.640170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacef7c-8849-4b4b-92dd-632e422e524b None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.640667 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacef7c-8849-4b4b-92dd-632e422e524b None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.641129 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacef7c-8849-4b4b-92dd-632e422e524b None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.642594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 94/179] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:43.643575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacef7c-8849-4b4b-92dd-632e422e524b None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.699331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 86/180] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:43.700175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.759655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacef7c-8849-4b4b-92dd-632e422e524b None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.786731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.797822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.808565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.808565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.808565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.808565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=4eef8c08fd624006b0498b56eda3d377) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:43.808565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.808565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.809689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 95/181] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/role_assignments?user.id=4eef8c08fd624006b0498b56eda3d377&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.810884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:43.811685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff88e-9a73-4729-85bf-6bbbb02f8843 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.851937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.852602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.852878 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.853140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.853968 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] RBAC: Adding query filter params (role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=acea4156218b49ab9e9c2878ec6bf879) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:43.854282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.856350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01f25-428e-4c78-b792-6635d9f60d8b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.863323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 87/182] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/role_assignments?user.id=acea4156218b49ab9e9c2878ec6bf879&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:43.864422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945530a1-483b-4363-a7d1-0d726c03587d None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.864704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945530a1-483b-4363-a7d1-0d726c03587d None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.864975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945530a1-483b-4363-a7d1-0d726c03587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.873522 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:43.884896 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-945530a1-483b-4363-a7d1-0d726c03587d None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:43.888268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-945530a1-483b-4363-a7d1-0d726c03587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:43.939040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bef2-1eaf-4339-be36-c09c20a31e79 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:43.965418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 88/183] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:43.980133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:43.981146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:43.981633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:43.982150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:43.983105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=94f2c13f07104f99a0a2e2b0c4560c1f, user.id=acea4156218b49ab9e9c2878ec6bf879) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:43.983616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:43.985342 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef983641-6232-4e57-96c5-873e3b752264 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:43.992415 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 96/184] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:43 2022] GET /identity/v3/role_assignments?user.id=acea4156218b49ab9e9c2878ec6bf879&scope.project.id=94f2c13f07104f99a0a2e2b0c4560c1f&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:44.008619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab161-e062-4f59-bd39-ff25c6ddd7ea None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.009126 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab161-e062-4f59-bd39-ff25c6ddd7ea None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.009199 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab161-e062-4f59-bd39-ff25c6ddd7ea None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.010991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 89/185] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:44.019709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a8d5-1ad5-4626-b4f0-30aa336461a4 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.020384 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a8d5-1ad5-4626-b4f0-30aa336461a4 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.020884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a8d5-1ad5-4626-b4f0-30aa336461a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.042833 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f586a8d5-1ad5-4626-b4f0-30aa336461a4 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:44.044642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f586a8d5-1ad5-4626-b4f0-30aa336461a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:44.126284 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 97/186] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:44.278603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab161-e062-4f59-bd39-ff25c6ddd7ea None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.291585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2d6a-f2c1-4bff-862b-b243e285541f None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.292265 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2d6a-f2c1-4bff-862b-b243e285541f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.292818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2d6a-f2c1-4bff-862b-b243e285541f None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.294818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 98/187] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:44.299704 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.300408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.300954 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.327083 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:44.328717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:44.363118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:44.388252 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:44.429582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab161-e062-4f59-bd39-ff25c6ddd7ea None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.460178 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 99/188] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:44.461412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.476124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.476766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.477195 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.477478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.491639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:44.496441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:44.497371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:44.498206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 90/189] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:44.503134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.594912 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d576ab-49e1-4935-b087-c7c4dfea0528 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.606009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87d28-7d05-4833-8e35-3d3980763a89 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.633051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.634164 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.634441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.634708 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.637531 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:44.643973 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.644579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.644932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.656432 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.656432 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:44.656642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:44.656734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:44.656734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:44.656894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:44.657880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 100/190] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:44.658858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.659893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 91/191] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:44.660728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.690740 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:44.762111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917dceb-640a-494e-822d-e6abc88a165e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.767543 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7906e-d599-4968-b937-93ebecff44b9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.794559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.795187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.795468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.795733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.799309 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.799908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.800183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.800449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.801117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:44.801416 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:44.802834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:44.805683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:44.811016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 92/192] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:44.811128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:44.811943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:44.812715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:44.813298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.813370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 101/193] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:44.813370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.869153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:44.902131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:44.910325 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f15c-8fb3-4b24-9872-4149282dc5a2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.912281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8628d7-28ff-47af-9a36-4e762e39073e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:44.944398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.945022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.945302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.945612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.946206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:44.946692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:44.946850 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:44.947104 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:44.947377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] PATH_INFO: `/v3/users/ed3f531afb824963a1897968b128b023` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:44.948134 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:44.949975 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 102/194] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:44.950579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:44.967044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3f531afb824963a1897968b128b023)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:44.968577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:44.970249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 93/195] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/users/ed3f531afb824963a1897968b128b023 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:44.971005 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.048687 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aca6e0-3d96-4304-87ff-99470380d9ec None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.066571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3d6b-75c1-4a66-a6e2-594af4dc51a7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.081251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.083190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.083813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.084088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.084355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] PATH_INFO: `/v3/users/718e16568bd549a3acaaa7586bad55de` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.085474 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] RBAC: Authorizing `identity:get_user(user_id=718e16568bd549a3acaaa7586bad55de)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.086985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.088628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 103/196] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/users/718e16568bd549a3acaaa7586bad55de => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:45.089821 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.102901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.103591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.103870 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.104143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.104968 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:45.105283 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.106670 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.114826 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 94/197] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:45.115615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.119028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.190595 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5620af-6ff7-4d1d-954b-b798bd39a657 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.213081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399bb4-0eae-407d-b0ac-4eb807e72108 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.225096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.225714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.226003 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.226276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.226917 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.228401 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.247414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.248023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.248303 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.248576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.293247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.314505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.315959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.361218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 104/198] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:45 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:45.362090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.427913 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 95/199] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:45.428833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.469851 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.487204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539f02-c074-4a5d-baf6-f9fbe34ed744 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.521439 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.527475 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.528170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.528450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.528721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.551475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddfd6b-292d-43de-af86-57320fe6d4d3 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.591636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.592961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.592961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.592961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] PATH_INFO: `/v3/users/ed3f531afb824963a1897968b128b023` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.594115 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3f531afb824963a1897968b128b023)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.595877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.604024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 96/200] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/users/ed3f531afb824963a1897968b128b023 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:45.604024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.614593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.616067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.714844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e74b28-fc78-44a7-ad0a-969de37ccdb3 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.715079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.737527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 105/201] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:45.737527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.753387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.754097 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.754487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.754680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.755777 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.758206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.760144 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 97/202] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:45.761086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.777271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.865933 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0f03-a9b4-4265-915f-f9c96a30aaca None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.885123 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daf868-2f0e-47f5-bfa4-c791d764bb9e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:45.906330 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.907188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.907616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.908263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.930655 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:45.931297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:45.931574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:45.932124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:45.934425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.935881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:45.938446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 98/203] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:45.939515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:45.976464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:45.997070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:45.999381 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:46.043068 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:46.065169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735d94-f7c8-4f78-af2d-5414118a2781 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:46.107039 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:46.107821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:46.108194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:46.108560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:46.109455 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=ed3f531afb824963a1897968b128b023) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:46.109882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:46.112085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:46.119171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 99/204] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/role_assignments?user.id=ed3f531afb824963a1897968b128b023&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:46.119171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:46.146953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 106/205] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:46.156833 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:46.257160 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:46.275077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f034-75ba-47a0-bd14-4fc4304a94d4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:46.322363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:46.324681 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:46.325092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:46.325506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:46.326880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:46.328526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:46.330624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 107/206] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:46 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:46.332059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0acc8a-48fe-4090-8c20-1bbbd9853ebd None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:46.345140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:46.400716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:46.401845 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:46.402158 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:46.402431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:46.403273 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] RBAC: Adding query filter params (role.id=de00389d088a488ab9ebd2e4984b644a, scope.project.id=0a98ceb5527d476588ffaa7358e80a99, user.id=718e16568bd549a3acaaa7586bad55de) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:46.403584 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:46.405043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7053a-b57b-427e-8af2-bcb1a48154b7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:46.421891 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 100/207] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:46 2022] GET /identity/v3/role_assignments?user.id=718e16568bd549a3acaaa7586bad55de&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=de00389d088a488ab9ebd2e4984b644a => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:46.494339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215faea-01f1-48db-ba38-7699b74acc0b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:46.540391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:46.541195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:46.541483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:46.541756 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:46.542596 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] RBAC: Adding query filter params (role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=ed3f531afb824963a1897968b128b023) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:46.542906 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:46.544417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbeb67-27fb-4e4a-adab-ce0bf86a044e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:46.551322 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 108/208] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:46 2022] GET /identity/v3/role_assignments?user.id=ed3f531afb824963a1897968b128b023&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:47.531481 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3874e-a76c-436c-8248-06e2aa2cf572 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:47.531977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3874e-a76c-436c-8248-06e2aa2cf572 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:47.532050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3874e-a76c-436c-8248-06e2aa2cf572 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:47.533680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 101/209] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:47.538741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32257-5553-49c4-a8c0-f0aa3b55eafe None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:47.539139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32257-5553-49c4-a8c0-f0aa3b55eafe None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:47.539323 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32257-5553-49c4-a8c0-f0aa3b55eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:47.558268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-aee32257-5553-49c4-a8c0-f0aa3b55eafe None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:47.559447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-aee32257-5553-49c4-a8c0-f0aa3b55eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:47.570972 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:47.634534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 109/210] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:47.732718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0b94-c9d4-4412-98e4-f168134ed7a1 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:47.732909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0b94-c9d4-4412-98e4-f168134ed7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:47.733183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0b94-c9d4-4412-98e4-f168134ed7a1 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:47.734769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 102/211] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:47.740071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:47.740363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:47.740638 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:47.759488 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:47.760728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:47.829665 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 110/212] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:47.910300 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0b94-c9d4-4412-98e4-f168134ed7a1 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:47.922601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.017214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0b94-c9d4-4412-98e4-f168134ed7a1 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.053572 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.054237 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.054519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.054793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.065747 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:48.070915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:48.071813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:48.072578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 103/213] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:48.079809 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.124999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.173855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.196612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234a14-f560-46cd-b9ab-9020d5ed410f None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.206178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.233462 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.234101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.234378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.234647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.235308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:48.235606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:48.236965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da87c6-9dbd-4575-aea1-334b72e6aeb7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:48.240547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8fbfb-1146-4a69-9a95-6fc22bee51d9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.246561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 111/214] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:48.249830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1503b9-5e25-4e98-8612-8ccb9c5df47c None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.249830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1503b9-5e25-4e98-8612-8ccb9c5df47c None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.249830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1503b9-5e25-4e98-8612-8ccb9c5df47c None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.249830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 112/215] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:48.252016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1503b9-5e25-4e98-8612-8ccb9c5df47c None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.330330 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91728d-8d33-4c89-a678-32aa967e1cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.330869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91728d-8d33-4c89-a678-32aa967e1cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.331165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91728d-8d33-4c89-a678-32aa967e1cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.331407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91728d-8d33-4c89-a678-32aa967e1cf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.332496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91728d-8d33-4c89-a678-32aa967e1cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:48.334374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91728d-8d33-4c89-a678-32aa967e1cf1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:48.335681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 104/216] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:48.336627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.336906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.337173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.356308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:48.357476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:48.408380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1503b9-5e25-4e98-8612-8ccb9c5df47c None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.426779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 105/217] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:48.427691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.453375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.454648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.454932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.455235 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] PATH_INFO: `/v3/users/a9a7b11f06be430cbac846a3c3190341` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.464802 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.471699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] RBAC: Authorizing `identity:get_user(user_id=a9a7b11f06be430cbac846a3c3190341)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:48.473407 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:48.479668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 113/218] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/users/a9a7b11f06be430cbac846a3c3190341 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:48.482848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.516043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.554160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012893c5-aa21-4927-8b25-9eb391a493f5 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.593037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3159a-20a3-4ca5-baaf-15d6b2d43306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.593556 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3159a-20a3-4ca5-baaf-15d6b2d43306 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.593838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3159a-20a3-4ca5-baaf-15d6b2d43306 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.594141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3159a-20a3-4ca5-baaf-15d6b2d43306 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.594788 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3159a-20a3-4ca5-baaf-15d6b2d43306 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:48.596218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3159a-20a3-4ca5-baaf-15d6b2d43306 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:48.607404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a08c-370f-4f94-a8dc-9d0514fa6edd None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.641554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841d717-95c6-4100-b2ff-ca20dd673c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.642283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d717-95c6-4100-b2ff-ca20dd673c7c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.642578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d717-95c6-4100-b2ff-ca20dd673c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.642826 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d717-95c6-4100-b2ff-ca20dd673c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.702380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.704641 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 106/219] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:48 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:48.705877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689058-9a92-448b-8cea-8157c63668b2 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.706194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689058-9a92-448b-8cea-8157c63668b2 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.706484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689058-9a92-448b-8cea-8157c63668b2 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.708020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 107/220] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:48.710792 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689058-9a92-448b-8cea-8157c63668b2 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.718060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841d717-95c6-4100-b2ff-ca20dd673c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:48.719633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841d717-95c6-4100-b2ff-ca20dd673c7c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:48.833856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 114/221] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:48.838745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689058-9a92-448b-8cea-8157c63668b2 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:48.840945 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.841245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.841520 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.860284 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:48.861394 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:48.863563 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:48.877590 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:48.878255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:48.878533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:48.878803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:48.891790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:48.896774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:48.903146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 108/222] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:48.903955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.954581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 115/223] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:48.954581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:48.991761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:49.028201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5064a-1165-439e-b253-d29e896bb9e7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.069386 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.070607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.070891 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.071166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.072579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.074934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.076611 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 109/224] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:49.082726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.096166 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531575f-ef04-4227-b6d2-41c5c42330c9 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.142082 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.143216 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.144105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.144895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.145742 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:49.146357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.146951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:49.148436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.159646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 116/225] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:49.165865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.211915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb133d85-a4ee-4a81-8ac5-098d614fbc83 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.252167 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.252782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.253060 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.253332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.254207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=a9a7b11f06be430cbac846a3c3190341) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:49.254526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.256093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.263209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 110/226] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:49 2022] GET /identity/v3/role_assignments?user.id=a9a7b11f06be430cbac846a3c3190341&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:49.270599 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.287782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:49.302442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473cc5b-e0ee-45a3-91af-21f7234121bb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.344265 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.345093 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.345498 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.345875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] PATH_INFO: `/v3/users/ed3f531afb824963a1897968b128b023` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.347295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3f531afb824963a1897968b128b023)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.348918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.351138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 117/227] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:49 2022] GET /identity/v3/users/ed3f531afb824963a1897968b128b023 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:49.357958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.436422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbff45-e352-4231-bc3f-1ce46c7f668c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.459805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:49.489200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.489843 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.490168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.490444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.521630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:49.523624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb856d-600b-4112-927b-6b450eae8fe3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:49.527349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:49.528187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:49.528966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 111/228] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:58:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:49.538877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.574599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.575676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.576146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.576606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.578007 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.579714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.581970 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 118/229] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:49 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:49.587911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.628558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:49.733825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a17b-d4aa-45aa-89d5-767cc601b207 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.761365 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7b7b-de1a-426c-9c31-def0d0ae21b2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:49.802000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.802979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.804365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.804833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.805904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:49.807239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.808826 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.823721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 112/230] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:49.824324 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:49.825266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:49.825757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:49.826240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494/users/ed3f531afb824963a1897968b128b023/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:49.828468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] RBAC: Authorizing `identity:create_grant(project_id=131b25681eae48e297bfa8d5c0338494, user_id=ed3f531afb824963a1897968b128b023, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:49.829309 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:49.830533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:49.873881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:49.928433 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 119/231] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:49 2022] PUT /identity/v3/projects/131b25681eae48e297bfa8d5c0338494/users/ed3f531afb824963a1897968b128b023/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:49.962270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d18c-22b4-4b8d-b55d-f156b6318795 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:50.016456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:50.017109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:50.017392 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:50.017665 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] PATH_INFO: `/v3/users/ed3f531afb824963a1897968b128b023` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:50.022793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3f531afb824963a1897968b128b023)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:50.024314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:50.027128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 113/232] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:49 2022] GET /identity/v3/users/ed3f531afb824963a1897968b128b023 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:50.032560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:50.165136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:50.186770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee18b-1565-431c-a80f-25cae81cdd47 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:50.223708 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed345354-1d11-4ffe-8c1e-ff61bdfc9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:50.224384 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed345354-1d11-4ffe-8c1e-ff61bdfc9105 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:50.224670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed345354-1d11-4ffe-8c1e-ff61bdfc9105 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:50.224942 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed345354-1d11-4ffe-8c1e-ff61bdfc9105 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:50.226101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed345354-1d11-4ffe-8c1e-ff61bdfc9105 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:50.227530 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed345354-1d11-4ffe-8c1e-ff61bdfc9105 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:50.229549 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 120/233] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:50 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:50.235748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:50.428815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762dd6-a6e4-4053-af24-823670bd95c2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:50.431743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:50.480306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03768f9d-3b96-4438-9e1b-3e0086910b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:50.481204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03768f9d-3b96-4438-9e1b-3e0086910b9e None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:50.481492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03768f9d-3b96-4438-9e1b-3e0086910b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:50.481773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03768f9d-3b96-4438-9e1b-3e0086910b9e None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494/users/ed3f531afb824963a1897968b128b023/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:50.488131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03768f9d-3b96-4438-9e1b-3e0086910b9e None admin] RBAC: Authorizing `identity:create_grant(project_id=131b25681eae48e297bfa8d5c0338494, user_id=ed3f531afb824963a1897968b128b023, role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:50.489606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03768f9d-3b96-4438-9e1b-3e0086910b9e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:50.597557 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 114/234] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:50 2022] PUT /identity/v3/projects/131b25681eae48e297bfa8d5c0338494/users/ed3f531afb824963a1897968b128b023/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:51.085955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2739b-bc89-4913-b600-30f7c68e9570 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.086462 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2739b-bc89-4913-b600-30f7c68e9570 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.086535 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2739b-bc89-4913-b600-30f7c68e9570 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.088364 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 121/235] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:51.094219 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540413-b39e-4e98-8ef0-a4acae41b492 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.094653 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540413-b39e-4e98-8ef0-a4acae41b492 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.094842 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540413-b39e-4e98-8ef0-a4acae41b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.119282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-e4540413-b39e-4e98-8ef0-a4acae41b492 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:51.120640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-e4540413-b39e-4e98-8ef0-a4acae41b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:51.208959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 115/236] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:51.381703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa780fa-5ef8-46b5-92d5-c3f926ec8094 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.382020 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa780fa-5ef8-46b5-92d5-c3f926ec8094 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.382204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa780fa-5ef8-46b5-92d5-c3f926ec8094 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.383566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 122/237] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:51.401850 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1ae0f-d7c0-4961-93c5-11a150dcde82 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.402170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1ae0f-d7c0-4961-93c5-11a150dcde82 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.402448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1ae0f-d7c0-4961-93c5-11a150dcde82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.426879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-ddf1ae0f-d7c0-4961-93c5-11a150dcde82 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:51.428076 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-ddf1ae0f-d7c0-4961-93c5-11a150dcde82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:51.518549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 116/238] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:51.599696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa780fa-5ef8-46b5-92d5-c3f926ec8094 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:51.699862 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad90cc9-592c-4167-b888-0a9db39457a0 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.700474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad90cc9-592c-4167-b888-0a9db39457a0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.700943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad90cc9-592c-4167-b888-0a9db39457a0 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.710676 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 117/239] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:51.716905 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.717341 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.717808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.719828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa780fa-5ef8-46b5-92d5-c3f926ec8094 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:51.755044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:51.756236 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:51.777103 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:51.777794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.778101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.778369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:51.799446 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:51.800069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:51.804724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:51.805564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:51.806363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:51.809045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 123/240] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:51.814705 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:51.835611 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:51.896205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 118/241] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:51.914149 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:51.939284 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1626-0990-4b46-abd8-873e5997ffc9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:51.997736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:51.998749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:51.999225 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:51.999698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.000563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:52.001056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:52.002686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:52.018090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 124/242] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:52.024044 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.043650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f051e5-e74d-4390-b907-b2fcee138bf6 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.080366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:52.081004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.081282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.081552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.082752 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:52.084209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:52.086120 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 119/243] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:52.092432 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.105339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:52.118140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:52.131569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07bff6-3b7f-4c50-b2f7-2e2f23daf5aa None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.179612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:52.180580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.181041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.181487 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] PATH_INFO: `/v3/users/5ef3c69aa19643ba96928fdf0ed76bb1` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.201662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5f6c-31e3-4aff-b822-5e01800b99cd None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.203270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] RBAC: Authorizing `identity:get_user(user_id=5ef3c69aa19643ba96928fdf0ed76bb1)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:52.213940 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:52.216174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 125/244] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:52 2022] GET /identity/v3/users/5ef3c69aa19643ba96928fdf0ed76bb1 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:52.221784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.237877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:52.238658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.238824 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.239261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.239978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:52.241480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:52.351337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 120/245] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:52 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:52.352998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.427877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0db39-4d42-49a4-900e-25d3b1c4415f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.497206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:52.503319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d24e7-0205-4341-889f-06ae05b03e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:52.504264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d24e7-0205-4341-889f-06ae05b03e75 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.504948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d24e7-0205-4341-889f-06ae05b03e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.505891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d24e7-0205-4341-889f-06ae05b03e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.537254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:52.569095 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d43b6-5f03-4e35-baf4-97b72245202c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.598625 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d24e7-0205-4341-889f-06ae05b03e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:52.600093 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d24e7-0205-4341-889f-06ae05b03e75 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:52.613262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bc31b-cabb-45c6-becb-7f32167f4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:52.613826 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc31b-cabb-45c6-becb-7f32167f4968 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.614141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc31b-cabb-45c6-becb-7f32167f4968 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.614415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc31b-cabb-45c6-becb-7f32167f4968 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.628124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bc31b-cabb-45c6-becb-7f32167f4968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-7f7bc31b-cabb-45c6-becb-7f32167f4968 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:52.638013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:52.638924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:52.639698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 121/246] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:52.640346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ddf5f-1d8c-4e18-9abe-861737a07e81 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.640346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ddf5f-1d8c-4e18-9abe-861737a07e81 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.641259 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ddf5f-1d8c-4e18-9abe-861737a07e81 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.648238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 122/247] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:52.653581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ddf5f-1d8c-4e18-9abe-861737a07e81 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.737331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 126/248] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:52.739099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.739606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.740096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.761586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:52.763436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:52.782463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ddf5f-1d8c-4e18-9abe-861737a07e81 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.800739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:52.827134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:52.828101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:52.828554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:52.829024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:52.829864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:52.830443 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:52.832270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:52.840077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:52.845339 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 123/249] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:52.846537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.869745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 127/250] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:52.869745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:52.977278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212742b-3e13-4843-a14f-403075e188a7 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:52.986080 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742bfee-8495-474c-b770-baded058bd26 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.024449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333dfce-980b-40e9-a1b2-6f3bcb2c3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.025283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333dfce-980b-40e9-a1b2-6f3bcb2c3525 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.025655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333dfce-980b-40e9-a1b2-6f3bcb2c3525 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.026568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333dfce-980b-40e9-a1b2-6f3bcb2c3525 None admin] PATH_INFO: `/v3/users/a9a7b11f06be430cbac846a3c3190341` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.027071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.028008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333dfce-980b-40e9-a1b2-6f3bcb2c3525 None admin] RBAC: Authorizing `identity:get_user(user_id=a9a7b11f06be430cbac846a3c3190341)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:53.028316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.028778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.029190 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.029864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333dfce-980b-40e9-a1b2-6f3bcb2c3525 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:53.030646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:53.031701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 128/251] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:52 2022] GET /identity/v3/users/a9a7b11f06be430cbac846a3c3190341 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:53.034969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1327f8-f725-4646-8c14-c40f0410e652 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.034969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1327f8-f725-4646-8c14-c40f0410e652 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.034969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1327f8-f725-4646-8c14-c40f0410e652 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.034969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 129/252] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:53.036050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:53.037992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 124/253] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:52 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:53.041369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.041369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.041369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.047771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.066749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:53.068038 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:53.097507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:53.159737 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:53.180125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 130/254] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:53.181453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.215534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b1af-fb55-494e-9674-6270d8d9d703 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.335286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.335912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.336193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.336464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.337200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] RBAC: Adding query filter params (role.id=de00389d088a488ab9ebd2e4984b644a, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=5ef3c69aa19643ba96928fdf0ed76bb1) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:53.337510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:53.341345 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000bda-4be4-420d-979f-3f9c3b93b669 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.344038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:53.357556 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 125/255] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:53 2022] GET /identity/v3/role_assignments?user.id=5ef3c69aa19643ba96928fdf0ed76bb1&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=de00389d088a488ab9ebd2e4984b644a => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:53.358210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.399443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.400098 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.400381 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.400649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.403138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:53.404622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:53.409066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 131/256] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:53 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:53.419609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.487533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:53.560228 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ac97-2a71-44de-b383-bbfab0159d92 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.596352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:53.602168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.602509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c37db-c926-46d8-836f-9a094d265279 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.603201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.603629 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.604215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.617780 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:53.624472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:53.625371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:58:53.626197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:53.629124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 126/257] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:53.630339 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.640618 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.641371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.641726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.642113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494/users/a9a7b11f06be430cbac846a3c3190341/roles/e724fe5c79a448c48fa8cdbb118400fe` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.644439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] RBAC: Authorizing `identity:create_grant(project_id=131b25681eae48e297bfa8d5c0338494, user_id=a9a7b11f06be430cbac846a3c3190341, role_id=e724fe5c79a448c48fa8cdbb118400fe)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:53.646124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:53.728642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 132/258] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:53 2022] PUT /identity/v3/projects/131b25681eae48e297bfa8d5c0338494/users/a9a7b11f06be430cbac846a3c3190341/roles/e724fe5c79a448c48fa8cdbb118400fe => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:53.734209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.754358 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d99d8e-6fdb-465f-b1f3-e2438cb7dfe1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.795667 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:53.796662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:53.797123 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:53.797573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:53.810453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:53.817458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:53.818537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:58:53.819327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:53.822253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 127/259] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:58:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:53.831096 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:53.914414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:53.966633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:53.975285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce90fe-9d83-42bb-9253-5bf3aacc4575 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:53.992384 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50a880-5792-4371-86cf-574df842ac0d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:54.020244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.021255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.021719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.022207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.023539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:54.024178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.026616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.038931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 128/260] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:58:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:54.041626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.043537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.043913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.044265 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.045008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:54.045251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:54.045368 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.046966 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.062560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 133/261] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:54.067590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:54.167275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879752-200c-4dc9-8bb8-f7c5aecbb44c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:54.183063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:54.205483 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.206582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.206969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.207348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] PATH_INFO: `/v3/users/ed3f531afb824963a1897968b128b023` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.208664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3f531afb824963a1897968b128b023)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.210345 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.212618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 129/262] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:54 2022] GET /identity/v3/users/ed3f531afb824963a1897968b128b023 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:54.218840 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:54.287148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b94050-5836-4ec7-b88f-26337910b896 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:54.365896 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.366925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.367401 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.367865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] PATH_INFO: `/v3/users/ed3f531afb824963a1897968b128b023` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.369445 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] RBAC: Authorizing `identity:get_user(user_id=ed3f531afb824963a1897968b128b023)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.371186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.377941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 134/263] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:54 2022] GET /identity/v3/users/ed3f531afb824963a1897968b128b023 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:54.379152 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:54.387308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85709c1-9c30-4a69-8074-9a1bc36d1ae2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:54.422265 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:54.425372 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.426138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.426525 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.426904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.484762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:54.505958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.507672 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.593749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71d49-3ef0-4a7f-a2f4-bf911376197c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:54.629376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 130/264] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:54.637302 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:54.675614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.676597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.677076 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.677545 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.783038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:54.811036 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c749cd-8b7e-4e64-aa8d-653a38688dc2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:54.848789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.851296 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.870319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:54.871191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:54.871490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:54.871772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:54.873655 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:54.875226 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:54.878011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 131/265] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:54 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:54.887252 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:54.893633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:55.045247 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 135/266] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:55.051051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:55.184681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec54992-b6e9-4986-990b-d1bee0612fb1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:55.245576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022330b-6d33-4a7e-8770-ad731223f452 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:55.267863 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:55.268496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.268779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.269037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.269779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] RBAC: Adding query filter params (role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=ed3f531afb824963a1897968b128b023) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:55.270115 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:55.271595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:55.282316 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:55.286382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 132/267] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:54 2022] GET /identity/v3/role_assignments?user.id=ed3f531afb824963a1897968b128b023&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 608 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:55.304293 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2415e-c8b8-4dee-a3a3-a6c4c4a3dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:55.305077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2415e-c8b8-4dee-a3a3-a6c4c4a3dcad None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.305203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2415e-c8b8-4dee-a3a3-a6c4c4a3dcad None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.305531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2415e-c8b8-4dee-a3a3-a6c4c4a3dcad None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.310143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2415e-c8b8-4dee-a3a3-a6c4c4a3dcad None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:55.311690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2415e-c8b8-4dee-a3a3-a6c4c4a3dcad None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:55.313834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 136/268] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:55 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:55.320819 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:55.344755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:55.409449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74faec-9255-4b0a-8cd1-b666006ed830 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.409770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74faec-9255-4b0a-8cd1-b666006ed830 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.410032 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74faec-9255-4b0a-8cd1-b666006ed830 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.411535 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 137/269] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:58:55.444009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d9483-d555-4ef6-8bc1-8a556b8b5e1a None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.444316 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d9483-d555-4ef6-8bc1-8a556b8b5e1a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.444473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d9483-d555-4ef6-8bc1-8a556b8b5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.475913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-a76d9483-d555-4ef6-8bc1-8a556b8b5e1a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:55.477181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-a76d9483-d555-4ef6-8bc1-8a556b8b5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:55.494470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581e7c-ff14-42b5-8a7a-849641bdc804 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:55.552365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:55.553003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.553287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.553562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.554343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=ed3f531afb824963a1897968b128b023) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:55.554651 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:55.556103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc179f-c9f8-4b97-ac75-286a73f3fb57 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:55.564512 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 133/270] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:55 2022] GET /identity/v3/role_assignments?user.id=ed3f531afb824963a1897968b128b023&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:55.612744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 138/271] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:55.771909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f88d3-f3a1-461c-8927-74fedd111bb5 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.772282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f88d3-f3a1-461c-8927-74fedd111bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.772511 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f88d3-f3a1-461c-8927-74fedd111bb5 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.773847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 134/272] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:55.779995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:55.780579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:55.781047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:55.804594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:55.806159 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:55.888825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 139/273] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:55.932620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f88d3-f3a1-461c-8927-74fedd111bb5 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.027433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:56.052224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f88d3-f3a1-461c-8927-74fedd111bb5 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.089717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.090396 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.090675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.090945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.106290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:56.111420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:56.112298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:56.113183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 135/274] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:56.118357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.176699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:56.219365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.232377 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e6f7f-4160-46e0-bce6-0dbf325b3747 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.272655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.273646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.274137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.274568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.275370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:56.275810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:56.277578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56163e60-6b11-465a-bd2f-a979661e2c3c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:56.286741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 140/275] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:56.288181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2d9e0-266e-4518-996d-7cdad42455d9 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.288461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2d9e0-266e-4518-996d-7cdad42455d9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.288732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2d9e0-266e-4518-996d-7cdad42455d9 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.293957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 141/276] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:56.293957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2d9e0-266e-4518-996d-7cdad42455d9 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.339501 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec429666-3ca2-404e-9511-a1f5ee856737 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.377172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab4dfa-3cb2-4c31-a36b-da1ef2ff1625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.377808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab4dfa-3cb2-4c31-a36b-da1ef2ff1625 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.378106 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab4dfa-3cb2-4c31-a36b-da1ef2ff1625 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.378379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab4dfa-3cb2-4c31-a36b-da1ef2ff1625 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.379485 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab4dfa-3cb2-4c31-a36b-da1ef2ff1625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:56.380924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab4dfa-3cb2-4c31-a36b-da1ef2ff1625 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:56.382716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 136/277] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:56.383605 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.383887 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.384162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.397789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:56.402973 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2d9e0-266e-4518-996d-7cdad42455d9 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.404750 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:56.405991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:56.412518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:56.440493 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.441158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.448523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.448523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] PATH_INFO: `/v3/users/95bd7f32479245fbac266606175762b0` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.456269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] RBAC: Authorizing `identity:get_user(user_id=95bd7f32479245fbac266606175762b0)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:56.457730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:56.459439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 142/278] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:56 2022] GET /identity/v3/users/95bd7f32479245fbac266606175762b0 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:56.459439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.485987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 137/279] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:56.485987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.571921 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab206-2e44-4830-be6a-6a273e52ddf1 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.598465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2032-4e11-4d40-929f-d7a55bd7f618 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.606224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.606837 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.607162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.607438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.608076 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:56.609495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:56.633549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.634583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.634583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.634761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.636171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, user.id=95bd7f32479245fbac266606175762b0, scope.system=all) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:56.636664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:56.638117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c39c-0084-4065-9730-2bb5bc9f1889 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:56.640884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:56.643686 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 138/280] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Aug 12 10:58:56 2022] GET /identity/v3/role_assignments?user.id=95bd7f32479245fbac266606175762b0&scope.system=all&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:56.644912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbcb2-77c7-4b80-a370-ee4c610dd4a5 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.645193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbcb2-77c7-4b80-a370-ee4c610dd4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.645459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbcb2-77c7-4b80-a370-ee4c610dd4a5 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.646850 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 139/281] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:56.653223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.653522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.653779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.673532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:56.674795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:56.719963 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 143/282] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:58:56 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:58:56.760029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:56.761827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 140/283] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:58:56.794622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:56.882874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fdfb6-5ba2-4647-90a4-924ce5f3db11 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:56.923494 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:56.924131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:56.924414 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:56.924682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:56.936070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:56.940752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:56.941614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:56.942668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 144/284] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:56.949608 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.046286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.071596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e692fe4-be94-4050-afae-68ac4c9291b0 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.109373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:57.117444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.118197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.118551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.118895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.121027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:57.121027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.121377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:57.134061 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 141/285] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:57.139008 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.160817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:57.190263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b04aa-a4e8-4856-896a-70773a9a3891 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.238685 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.240073 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.240985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.241463 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.255869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:57.263534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:57.264434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:57.265188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:58:57.267295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 145/286] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:58:57.269940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc2e21-7e1a-40b8-a635-103ae2be611b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.274881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.311319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.312240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.312600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.313012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] PATH_INFO: `/v3/users/5ef3c69aa19643ba96928fdf0ed76bb1` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.314507 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] RBAC: Authorizing `identity:get_user(user_id=5ef3c69aa19643ba96928fdf0ed76bb1)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.316140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:57.322193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 142/287] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:57 2022] GET /identity/v3/users/5ef3c69aa19643ba96928fdf0ed76bb1 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:57.324979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.402291 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138694e-0568-47f4-a1ec-8a0368bc352c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.429248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:57.445966 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.445966 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.446538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.446538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.447125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:57.447431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.449413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:57.458695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 146/288] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:57.465236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.478705 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:57.524390 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def6a7a-51e9-4201-af31-00b5a5a4cc4b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.590430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.591062 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.591350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.591624 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.592921 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.594383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:57.596016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 143/289] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:57 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:57.603218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.624084 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850be9c-02be-44eb-99c9-2dd1ef7f7de9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.701323 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.701897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.702202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.702525 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] PATH_INFO: `/v3/users/a9a7b11f06be430cbac846a3c3190341` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.703730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] RBAC: Authorizing `identity:get_user(user_id=a9a7b11f06be430cbac846a3c3190341)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.705238 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:57.708820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 147/290] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:57 2022] GET /identity/v3/users/a9a7b11f06be430cbac846a3c3190341 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:57.715023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:57.759169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfd0bb-de97-452c-9c03-3a0ef5ecfe01 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.788980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:57.796050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:57.806218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.809877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.809877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.809877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494/users/5ef3c69aa19643ba96928fdf0ed76bb1/roles/de00389d088a488ab9ebd2e4984b644a` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.810829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] RBAC: Authorizing `identity:create_grant(project_id=131b25681eae48e297bfa8d5c0338494, user_id=5ef3c69aa19643ba96928fdf0ed76bb1, role_id=de00389d088a488ab9ebd2e4984b644a)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.812756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:57.826086 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267d7ed-30a3-4f0c-bd41-7383423f6041 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:57.862472 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:57.863148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:57.863429 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:57.863699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:57.892690 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 144/291] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:58:57 2022] PUT /identity/v3/projects/131b25681eae48e297bfa8d5c0338494/users/5ef3c69aa19643ba96928fdf0ed76bb1/roles/de00389d088a488ab9ebd2e4984b644a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:58:57.940903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:57.942431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:58.024220 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:58.052285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 148/292] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:58.058248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:58.204534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0773d9-299d-49bb-b761-c0cc72b2dc9d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:58.241302 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cede0-abab-43fe-9838-7e07a6ba0d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:58.242307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cede0-abab-43fe-9838-7e07a6ba0d88 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:58.242783 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cede0-abab-43fe-9838-7e07a6ba0d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:58.243244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cede0-abab-43fe-9838-7e07a6ba0d88 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:58.245165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cede0-abab-43fe-9838-7e07a6ba0d88 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:58.247113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cede0-abab-43fe-9838-7e07a6ba0d88 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:58.250479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 145/293] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:58:58 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:58.257950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:58.399910 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174937-e227-463f-8c44-683f904a75f2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:58.442438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:58.443323 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:58.443832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:58.444400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:58.445350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=a9a7b11f06be430cbac846a3c3190341) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:58.445847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:58.447512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db23ae7-cc42-4f13-b0d2-329c94dc7611 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:58.455421 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 149/294] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:58:58 2022] GET /identity/v3/role_assignments?user.id=a9a7b11f06be430cbac846a3c3190341&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:58.949756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd430-4748-4c00-af3d-4c4b27aaf714 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:58.950306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd430-4748-4c00-af3d-4c4b27aaf714 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:58.950306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd430-4748-4c00-af3d-4c4b27aaf714 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:58.951939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 146/295] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:58.957221 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af7d3-09e9-41d5-8664-207ddecac2b9 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:58.957512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af7d3-09e9-41d5-8664-207ddecac2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:58.957787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af7d3-09e9-41d5-8664-207ddecac2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:58.976233 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-4a9af7d3-09e9-41d5-8664-207ddecac2b9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:58.977417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-4a9af7d3-09e9-41d5-8664-207ddecac2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:59.007827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:59.048656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 150/296] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:59.094258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3eba-464d-44ba-b438-7f67c23c2301 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.094547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3eba-464d-44ba-b438-7f67c23c2301 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.094809 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3eba-464d-44ba-b438-7f67c23c2301 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.096289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 147/297] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:59.103188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78cb6-3e99-40d9-972f-327af7573091 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.103476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78cb6-3e99-40d9-972f-327af7573091 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.103752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78cb6-3e99-40d9-972f-327af7573091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.124241 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-64a78cb6-3e99-40d9-972f-327af7573091 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:59.125419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-64a78cb6-3e99-40d9-972f-327af7573091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:59.205070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 151/298] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:59.337449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3eba-464d-44ba-b438-7f67c23c2301 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.398062 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:59.450088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3eba-464d-44ba-b438-7f67c23c2301 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:59.481770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e749-10c4-4752-9f15-da37de1e08f5 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.482282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e749-10c4-4752-9f15-da37de1e08f5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.482282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e749-10c4-4752-9f15-da37de1e08f5 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.484189 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 152/299] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:58:59.487898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:59.489646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.489953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.490256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.493999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.494287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.494669 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.508080 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:59.509543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:58:59.511280 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:59.513725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:59.514749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:59.515509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 148/300] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:59.516128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.585163 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 153/301] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:58:59.586067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.621428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:59.634778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c062-d0ea-4067-9e6e-cd62c8fc6551 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:59.657636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:59.684412 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:59.685897 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.686429 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.686908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.701266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:58:59.709291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:58:59.710169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:58:59.711023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:58:59.711596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 149/302] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:58:59.714693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72409e0d-fe51-421e-bb58-f519d36fc584 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:59.717810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.755593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:59.756616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.757087 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.757562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.758436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:59.758929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:59.761151 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:59.770130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 154/303] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:58:59.775851 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.825066 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995bfae-987d-4d05-b613-15b49614c56d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:59.861141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:59.861758 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.862079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.862353 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.863021 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:58:59.863329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:59.864704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:59.870831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:59.873875 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 150/304] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:59.874694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.887073 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ecfe-119f-43e4-a30f-0b587e379310 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:59.917129 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:59.928422 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:59.929057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:59.929339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:59.929610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] PATH_INFO: `/v3/users/95bd7f32479245fbac266606175762b0` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:59.930878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] RBAC: Authorizing `identity:get_user(user_id=95bd7f32479245fbac266606175762b0)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:59.932443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:59.938739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 155/305] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/users/95bd7f32479245fbac266606175762b0 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:58:59.938739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:59.985410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dada2-56ac-4569-b651-e1ac398194cc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:00.020960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:00.021515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.021800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.022128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.023248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:00.024697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:00.026880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 151/306] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:00.030901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:00.046007 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7baad-f65b-4134-8bd9-4473c977afbc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:00.083801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:00.084435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.084717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.084989 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] PATH_INFO: `/v3/users/e01e9cae71b44a7083ea0d11066f5854` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.098677 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] RBAC: Authorizing `identity:get_user(user_id=e01e9cae71b44a7083ea0d11066f5854)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:00.100174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:00.107143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 156/307] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:58:59 2022] GET /identity/v3/users/e01e9cae71b44a7083ea0d11066f5854 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:00.107143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:00.117870 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:00.145586 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c769-7ab8-44b1-a3ea-b74c53f3f111 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:00.153156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:00.185872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:00.186551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.186828 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.187104 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] PATH_INFO: `/v3/system/users/95bd7f32479245fbac266606175762b0/roles/e724fe5c79a448c48fa8cdbb118400fe` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.188510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=95bd7f32479245fbac266606175762b0, role_id=e724fe5c79a448c48fa8cdbb118400fe)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:00.189884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:00.203481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933feb06-7bb9-4acb-880c-3c78ca9c7f7d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:00.236026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6897e8-7b03-4016-a427-f429fae765a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:00.236627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6897e8-7b03-4016-a427-f429fae765a4 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.236904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6897e8-7b03-4016-a427-f429fae765a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.237173 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6897e8-7b03-4016-a427-f429fae765a4 None admin] PATH_INFO: `/v3/groups` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.237784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6897e8-7b03-4016-a427-f429fae765a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:00.239219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6897e8-7b03-4016-a427-f429fae765a4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:00.293233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 152/308] 10.222.0.40 () {58 vars in 1334 bytes} [Fri Aug 12 10:59:00 2022] PUT /identity/v3/system/users/95bd7f32479245fbac266606175762b0/roles/e724fe5c79a448c48fa8cdbb118400fe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:00.294153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:00.404317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 157/309] 10.222.0.40 () {60 vars in 1134 bytes} [Fri Aug 12 10:59:00 2022] POST /identity/v3/groups => generated 229 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:00.405675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204b89-eb47-4524-adeb-f587ed1b1e4e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.405858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc8ab5-0f7c-465e-aabc-5c4e90318e46 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:00.405989 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204b89-eb47-4524-adeb-f587ed1b1e4e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.406264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204b89-eb47-4524-adeb-f587ed1b1e4e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.408175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 158/310] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:00.414305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.414583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.414853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.437230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:00.437756 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:00.461376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:00.462470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.462919 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.463953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.465003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] RBAC: Adding query filter params (role.id=de00389d088a488ab9ebd2e4984b644a, user.id=e01e9cae71b44a7083ea0d11066f5854, scope.system=all) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:00.465164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:00.466722 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:00.474554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 153/311] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Aug 12 10:59:00 2022] GET /identity/v3/role_assignments?user.id=e01e9cae71b44a7083ea0d11066f5854&scope.system=all&role.id=de00389d088a488ab9ebd2e4984b644a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:00.538116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 159/312] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:00.802685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:00.837161 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:00.902329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9b5b-6dc3-470f-83c3-4447d51c9b0e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:00.937440 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:00.938099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:00.938384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:00.938649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:00.951480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:00.956598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:00.957449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:59:00.958238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:00.962022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 154/313] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:00.964204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:00.967425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:01.067841 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c83ce-5b7b-4a5b-9ffc-b73ac5ed67e6 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:01.101849 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:01.102502 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:01.102779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:01.103049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:01.103711 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:01.104303 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:01.105666 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:01.118024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 160/314] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:01.120147 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:01.219551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:01.226965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9f87c-dc15-41a5-9901-c52f8093ca23 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:01.262382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:01.263006 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:01.263329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:01.263600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] PATH_INFO: `/v3/users/5ef3c69aa19643ba96928fdf0ed76bb1` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:01.264726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] RBAC: Authorizing `identity:get_user(user_id=5ef3c69aa19643ba96928fdf0ed76bb1)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:01.266191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:01.267839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 155/315] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:59:01 2022] GET /identity/v3/users/5ef3c69aa19643ba96928fdf0ed76bb1 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:01.273981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:01.367954 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:01.404973 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e069-7a25-4993-9eaa-5de15c4d821c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:01.441696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:01.444054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:01.444054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:01.444054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:01.518217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:01.519669 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:01.586723 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:01.627346 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 161/316] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:59:01.628712 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:01.732967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13960d9-5235-4dc7-8b1b-8d3bd109f963 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:01.767656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9f796-c457-42c6-880f-67b9e95c4c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:01.768284 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9f796-c457-42c6-880f-67b9e95c4c75 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:01.768562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9f796-c457-42c6-880f-67b9e95c4c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:01.768890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9f796-c457-42c6-880f-67b9e95c4c75 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:01.770034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9f796-c457-42c6-880f-67b9e95c4c75 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:01.771476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9f796-c457-42c6-880f-67b9e95c4c75 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:01.773153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 156/317] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:01 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:01.779396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:01.881814 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45741f-bd0a-46af-92b6-fcbfed512c9a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:01.918365 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:01.918981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:01.919261 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:01.919528 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:01.920322 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] RBAC: Adding query filter params (role.id=de00389d088a488ab9ebd2e4984b644a, scope.project.id=131b25681eae48e297bfa8d5c0338494, user.id=5ef3c69aa19643ba96928fdf0ed76bb1) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:01.920629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:01.922077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992c5a-143c-4438-addb-4623a58ce5b8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:01.934086 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 162/318] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:01 2022] GET /identity/v3/role_assignments?user.id=5ef3c69aa19643ba96928fdf0ed76bb1&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=de00389d088a488ab9ebd2e4984b644a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:02.322043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda166-cc86-4ce6-bb78-ff4e6a2a7d90 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.322588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda166-cc86-4ce6-bb78-ff4e6a2a7d90 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.322667 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda166-cc86-4ce6-bb78-ff4e6a2a7d90 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.324470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 157/319] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:02.329442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16829-f9b4-4036-b180-2d5b7ac59f07 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.329736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16829-f9b4-4036-b180-2d5b7ac59f07 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.330043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16829-f9b4-4036-b180-2d5b7ac59f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.347967 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-ada16829-f9b4-4036-b180-2d5b7ac59f07 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:02.349144 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-ada16829-f9b4-4036-b180-2d5b7ac59f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:02.374278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:02.415030 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef8dd-6114-41de-8406-81468f94e02b None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.415359 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef8dd-6114-41de-8406-81468f94e02b None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.415583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef8dd-6114-41de-8406-81468f94e02b None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.418213 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 158/320] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:02.421951 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 163/321] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:02.423112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb775b3-2bb1-47ca-b208-5477ad15d0f2 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.423348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb775b3-2bb1-47ca-b208-5477ad15d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.423628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb775b3-2bb1-47ca-b208-5477ad15d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.442754 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-1cb775b3-2bb1-47ca-b208-5477ad15d0f2 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:02.444181 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-1cb775b3-2bb1-47ca-b208-5477ad15d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:02.467889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:02.511600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 159/322] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:02.528290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5371263-7804-4151-a2b7-d52a70bd395a None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.528573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5371263-7804-4151-a2b7-d52a70bd395a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.528844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5371263-7804-4151-a2b7-d52a70bd395a None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.530412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 164/323] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:02.535331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.535620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.535893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.555377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:02.556550 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:02.621608 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 160/324] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:02.695786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5371263-7804-4151-a2b7-d52a70bd395a None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:02.792411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:02.798627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5371263-7804-4151-a2b7-d52a70bd395a None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:02.834803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:02.835430 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.835717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.835986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.848095 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:02.852800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:02.853699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:02.855187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 165/325] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:02.860268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:02.883579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:02.890546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:02.899906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d641d-e724-44ab-904b-950a15b07d86 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:02.933853 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:02.934506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.934781 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.935047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.944627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:02.950078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:02.951043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:02.951808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 161/326] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:02.952458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:02.962577 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb6cc2-baaa-49bc-b17d-40f688086c9b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:02.995977 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:02.996586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:02.996866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:02.997137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:02.997793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:02.998126 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:02.999512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.007276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 166/327] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:03.010850 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:03.050047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04cc9a-082f-4d38-a57c-f01348c1abcc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.083128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.083752 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.084032 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.084306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.085416 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.086894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.088642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 162/328] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:03.089393 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:03.095948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:03.108367 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:03.114404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd2149-649a-4cb3-bc35-abcd948ef536 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.148741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.149282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.149562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.149836 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.150542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:03.150834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.152209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.160548 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 167/329] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:03.161321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:03.191287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d648b-1abb-468b-bd6b-3617d2f6875e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.223911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.224532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.224813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.225083 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] PATH_INFO: `/v3/users/95bd7f32479245fbac266606175762b0` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.226240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] RBAC: Authorizing `identity:get_user(user_id=95bd7f32479245fbac266606175762b0)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.227674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.229878 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 163/330] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:59:03 2022] GET /identity/v3/users/95bd7f32479245fbac266606175762b0 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:03.230663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:03.263380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903624-bad3-40a5-8592-d3f30ed04148 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.296641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.297240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.297520 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.297788 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] PATH_INFO: `/v3/groups` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.298437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.299985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.317479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:03.331841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22a7c-e160-473c-ab2a-981518aac458 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.363554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.364176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.364456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.364775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] PATH_INFO: `/v3/users/e01e9cae71b44a7083ea0d11066f5854` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.365909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] RBAC: Authorizing `identity:get_user(user_id=e01e9cae71b44a7083ea0d11066f5854)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.367369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.368927 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 164/331] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:59:03 2022] GET /identity/v3/users/e01e9cae71b44a7083ea0d11066f5854 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:03.370539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:03.394030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 168/332] 10.222.0.40 () {60 vars in 1134 bytes} [Fri Aug 12 10:59:03 2022] POST /identity/v3/groups => generated 226 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:03.394030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:03.394030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:03.490352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f623d-4eb9-4a2b-ab89-a79fc31802bb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.505956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30d749-d517-4021-9722-f02727ac1497 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:03.528168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.528773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.529058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.529321 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.530079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] RBAC: Adding query filter params (role.id=e724fe5c79a448c48fa8cdbb118400fe, user.id=95bd7f32479245fbac266606175762b0, scope.system=all) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:03.530384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.531827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf2f5-471c-468d-a552-6febc4c79a4d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.542746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8bd93-2a20-4021-8b3f-97908c1243ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:03.543485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8bd93-2a20-4021-8b3f-97908c1243ad None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:03.543772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8bd93-2a20-4021-8b3f-97908c1243ad None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:03.544052 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8bd93-2a20-4021-8b3f-97908c1243ad None admin] PATH_INFO: `/v3/system/users/e01e9cae71b44a7083ea0d11066f5854/roles/de00389d088a488ab9ebd2e4984b644a` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:03.545300 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 165/333] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Aug 12 10:59:03 2022] GET /identity/v3/role_assignments?user.id=95bd7f32479245fbac266606175762b0&scope.system=all&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:03.545533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8bd93-2a20-4021-8b3f-97908c1243ad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e01e9cae71b44a7083ea0d11066f5854, role_id=de00389d088a488ab9ebd2e4984b644a)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:03.547017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8bd93-2a20-4021-8b3f-97908c1243ad None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:03.618732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 169/334] 10.222.0.40 () {58 vars in 1334 bytes} [Fri Aug 12 10:59:03 2022] PUT /identity/v3/system/users/e01e9cae71b44a7083ea0d11066f5854/roles/de00389d088a488ab9ebd2e4984b644a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:05.540699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c18c44-0e59-46c4-8854-b60780f6fcc0 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:05.542076 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c18c44-0e59-46c4-8854-b60780f6fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:05.542560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c18c44-0e59-46c4-8854-b60780f6fcc0 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:05.544522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 166/335] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:05.549642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2968f0-460d-4464-a4b9-3cd8307da362 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:05.550486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2968f0-460d-4464-a4b9-3cd8307da362 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:05.551134 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2968f0-460d-4464-a4b9-3cd8307da362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:05.573482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-fd2968f0-460d-4464-a4b9-3cd8307da362 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:05.575020 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-fd2968f0-460d-4464-a4b9-3cd8307da362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:05.646139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:05.653264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 170/336] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:05.879821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5c87-2dd0-47a1-9928-74ea4dee9842 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:05.880456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5c87-2dd0-47a1-9928-74ea4dee9842 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:05.880938 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5c87-2dd0-47a1-9928-74ea4dee9842 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:05.882786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 167/337] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:05.889597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:05.890218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:05.890694 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:05.919015 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:05.920567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:05.920927 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b884a-d39a-4fe8-9ee5-6b61f004ce2f None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:05.921466 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b884a-d39a-4fe8-9ee5-6b61f004ce2f None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:05.921959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b884a-d39a-4fe8-9ee5-6b61f004ce2f None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:05.923932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 168/338] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:05.936124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d237f-f020-4a06-a56e-39e62389484f None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:05.936739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d237f-f020-4a06-a56e-39e62389484f None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:05.937208 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d237f-f020-4a06-a56e-39e62389484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:05.974571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-163d237f-f020-4a06-a56e-39e62389484f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:05.976130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-163d237f-f020-4a06-a56e-39e62389484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:05.985061 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:06.036507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 171/339] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:06.104992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 169/340] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:06.116962 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:06.258576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c26fe9-a1f9-47ed-adb9-9d91026188d9 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:06.300262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:06.308498 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:06.309142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:06.309480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:06.309766 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:06.324712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:06.329436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:06.334901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:06.335672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 172/341] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:06.337787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d237f-f020-4a06-a56e-39e62389484f None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:06.460374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d237f-f020-4a06-a56e-39e62389484f None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:06.495466 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:06.508345 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:06.509018 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:06.509246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:06.509520 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:06.510288 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:06.510590 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:06.511961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:06.521115 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 170/342] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:06.527518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:06.531871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:06.665349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd219f1-bf55-469d-9816-bdce2b486d27 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:06.724943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:06.725900 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7f73-9907-44cf-ba7c-38699a1990ff None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:06.726521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:06.726990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:06.727533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:06.744085 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:06.750468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:06.751355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:06.752176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:06.755023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 173/343] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:06.756208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:06.769764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02538e-1e72-4634-a38e-1ace048cff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:06.770382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02538e-1e72-4634-a38e-1ace048cff7a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:06.772743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02538e-1e72-4634-a38e-1ace048cff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:06.772743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02538e-1e72-4634-a38e-1ace048cff7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:06.822353 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:06.866325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02538e-1e72-4634-a38e-1ace048cff7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:06.868144 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02538e-1e72-4634-a38e-1ace048cff7a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:06.873271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:06.894774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3db3f6-8741-4be1-8fd2-fe505ae10620 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:06.941600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8b617-dea2-44ef-85b9-de426ae1d51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:06.942845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8b617-dea2-44ef-85b9-de426ae1d51c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:06.943125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8b617-dea2-44ef-85b9-de426ae1d51c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:06.943402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8b617-dea2-44ef-85b9-de426ae1d51c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:06.956105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8b617-dea2-44ef-85b9-de426ae1d51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-cae8b617-dea2-44ef-85b9-de426ae1d51c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:06.961347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:06.962329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:06.963226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 174/344] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:06.963986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890ca4-e10e-479f-ba13-afa6faf7dd4f None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:06.964560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890ca4-e10e-479f-ba13-afa6faf7dd4f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:06.964560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890ca4-e10e-479f-ba13-afa6faf7dd4f None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:06.965745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 175/345] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:06.970079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890ca4-e10e-479f-ba13-afa6faf7dd4f None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.004852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 171/346] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:07.006990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.007444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.007923 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.028526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:07.029996 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:07.085500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890ca4-e10e-479f-ba13-afa6faf7dd4f None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.096594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.109105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 172/347] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:07.110234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.128129 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.128808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.129191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.129688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.130508 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:07.130921 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.132779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.142376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 176/348] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:07.143547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.150432 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.224574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a326a-fd07-427e-9f64-fb1359af495b None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.255842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcccf7-4bbd-4951-aac1-7591392bf6d6 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.262747 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.263711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.264251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.264733 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.265689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:07.266216 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.267981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6ece1-21c4-426f-805d-12b17c20b949 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.282119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 173/349] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:07.283827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659602-ce0d-4f2b-8300-86b79f7064ce None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.284327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659602-ce0d-4f2b-8300-86b79f7064ce None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.284849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659602-ce0d-4f2b-8300-86b79f7064ce None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.286757 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 174/350] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:07.287841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be659602-ce0d-4f2b-8300-86b79f7064ce None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.295604 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02987e39-15f4-44ef-bb3d-4b54f845506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.296247 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02987e39-15f4-44ef-bb3d-4b54f845506e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.296534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02987e39-15f4-44ef-bb3d-4b54f845506e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.296806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02987e39-15f4-44ef-bb3d-4b54f845506e None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.297981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02987e39-15f4-44ef-bb3d-4b54f845506e None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.299555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02987e39-15f4-44ef-bb3d-4b54f845506e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.301315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 177/351] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:07.302647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.303278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.303384 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.324341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:07.325690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:07.363338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.399112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.409609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 178/352] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:07.412073 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.412320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be659602-ce0d-4f2b-8300-86b79f7064ce None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.475593 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.476637 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.477112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.477578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.532648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b8053-c81b-47f7-ab90-8894fd9298d7 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.550500 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.552300 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.572985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.573794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.574111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.574390 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] PATH_INFO: `/v3/users/e01e9cae71b44a7083ea0d11066f5854` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.575662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=e01e9cae71b44a7083ea0d11066f5854)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.577271 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.579370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 179/353] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/users/e01e9cae71b44a7083ea0d11066f5854 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:07.579886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.618785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.660875 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.668589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 175/354] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:07.669657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.695355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7de7-11f0-42cb-8277-8062acb52ba7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.741988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.742462 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.742737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.743006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.750136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.751576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.753488 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 180/355] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:07.755552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.804694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9d63-4edb-4ca4-86ab-5714b597f229 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.852895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.852895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.852895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.852895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.863697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:07.868821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:07.869832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 176/356] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:07.872210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:07.896601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.900137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f5b0-7348-4b11-8c27-1c06f9381e20 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:07.943313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:07.944471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:07.944993 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:07.946473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:07.947981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] RBAC: Adding query filter params (role.id=de00389d088a488ab9ebd2e4984b644a, user.id=e01e9cae71b44a7083ea0d11066f5854, scope.system=all) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:07.948473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:07.950098 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:07.952662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:07.965764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 181/357] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/role_assignments?user.id=e01e9cae71b44a7083ea0d11066f5854&scope.system=all&role.id=de00389d088a488ab9ebd2e4984b644a => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:07.966891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.011102 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1f34-6d2e-46fe-8bf2-3e2bf58b6961 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.052079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.053038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.053038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.053344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.054643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.056214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.059077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 177/358] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:08.059382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.097319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d3cf-231d-40f7-8d14-cd641acf56bc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.142348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.143007 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.143285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.143553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.158036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:08.163239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:08.164099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:08.164903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 182/359] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:08.165563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.190969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:08.203113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a683-4691-44c9-b433-c0170ead69d4 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.229849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:08.241194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.241805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.242162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.242436 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.243173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=0a98ceb5527d476588ffaa7358e80a99) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:08.243482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.245901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.251721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 178/360] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:08.257947 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.299636 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c013a0-aec3-4b6e-9302-eb566d86f569 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.346264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.346817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.347101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.347376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.348058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:08.348362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.350004 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553a49a-90af-401e-b770-841c54917f0f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.361999 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 183/361] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:08.364604 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a285a-20b2-4f19-bfaa-1f80c04771a2 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.364896 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a285a-20b2-4f19-bfaa-1f80c04771a2 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.365174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a285a-20b2-4f19-bfaa-1f80c04771a2 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.367028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 184/362] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:08.367856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a285a-20b2-4f19-bfaa-1f80c04771a2 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.395295 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60c69-4dd0-405c-822c-dd0a3f3f49b0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.443965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.443965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.443965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.443965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.445344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.447086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.450161 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 179/363] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:08.450802 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.480343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:08.508121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a285a-20b2-4f19-bfaa-1f80c04771a2 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.519248 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:08.557194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.557932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.558237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.558514 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.559193 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:08.559497 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.560919 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee22f7-0f46-4d91-982c-11b247877a40 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.570202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 185/364] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:08.571719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.572003 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.572821 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.590939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b28736-acca-47c6-9a41-83127d7a3a83 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.594253 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:08.595449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:08.631297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.631297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.631297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.631297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.686008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 186/365] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:08.686713 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.708491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.710007 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.771089 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:08.781792 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:08.813873 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205269f-1b71-4379-ae34-b4aa170bc2d0 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:08.833112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 180/366] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:08.833806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:08.863559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:08.864496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:08.864779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:08.865100 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:08.866108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=0a98ceb5527d476588ffaa7358e80a99) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:08.866417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:08.867861 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:08.876880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 187/367] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:08.882584 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.016948 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767db7f-8237-4fd0-86fe-2b8fb133290f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.056000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.057247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.057814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.058227 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.063097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f3c8-93ca-4d4f-b6bf-8d604acecba1 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.087733 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.101624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.104123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.104123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.104123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.104677 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.106151 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.108896 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 188/368] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:09.108896 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.119975 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.148988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.150481 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.224370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf67bff-b74b-440f-aa4d-0799f4419886 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.261176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 181/369] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:09.262054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.265639 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.266318 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.266598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.266880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.280600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:09.286859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:09.287768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:09.288981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 189/370] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:09.289621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.321594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.369567 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c6800-56c6-450e-a61b-f51d422456aa None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.402716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.405468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.406255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.406632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.406997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.408209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.408536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286efa17-03fa-477b-a12b-3aec2b25b11e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.409850 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.411976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 182/371] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:09.412851 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.467926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.468815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.469286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.469728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.471125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.472899 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.475217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 190/372] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:09.476167 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.525718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b0f79-c2d9-4d4c-b954-e39c8b6068a9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.553607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.565739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.566469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.566811 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.571270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.571270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:09.571270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.571270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.580025 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 183/373] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:09.580943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.602927 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa8686-3d92-4733-8e0d-ed753bbc6890 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.639003 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.641181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.641900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.642223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.642501 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.643339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=131b25681eae48e297bfa8d5c0338494) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:09.643657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.645227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.651947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 191/374] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:09.656530 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.692735 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee3a0-b67b-465c-baf2-9bc121ed8242 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.737063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.737750 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.738080 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.738354 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.739541 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.740980 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.742905 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 184/375] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:09.756373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:09.819019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b323f-07ac-4f6a-bb56-90c63c4ab077 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:09.866873 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:09.867509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:09.867787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:09.868058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:09.918204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.958337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:09.963417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:09.965262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:09.976289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626943-5ca6-4b61-9367-9512aef4f9d2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:10.018880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:10.019499 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:10.019780 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:10.020053 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:10.020787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=131b25681eae48e297bfa8d5c0338494) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:10.021704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:10.023273 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:10.029669 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 185/376] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:10.103875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 192/377] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:10.109709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:10.239965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be4d5e-f0e0-4d39-bb45-e80c9564888e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:10.263225 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:10.282797 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15bb23-1588-4f61-aa7b-c928c31e8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:10.283450 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15bb23-1588-4f61-aa7b-c928c31e8820 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:10.283734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15bb23-1588-4f61-aa7b-c928c31e8820 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:10.284009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15bb23-1588-4f61-aa7b-c928c31e8820 None admin] PATH_INFO: `/v3/projects/254545a5250741a0bf9da613f7749ee7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:10.285255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15bb23-1588-4f61-aa7b-c928c31e8820 None admin] RBAC: Authorizing `identity:get_project(project_id=254545a5250741a0bf9da613f7749ee7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:10.286888 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15bb23-1588-4f61-aa7b-c928c31e8820 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:10.289111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 186/378] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:10 2022] GET /identity/v3/projects/254545a5250741a0bf9da613f7749ee7 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:10.295442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:10.406732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:10.414916 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e64d7-24f1-4ec6-98c0-84784e5368ff None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:10.415195 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e64d7-24f1-4ec6-98c0-84784e5368ff None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:10.415467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e64d7-24f1-4ec6-98c0-84784e5368ff None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:10.417423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 187/379] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:10.418884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d7e6-654a-4d72-a0f5-a32f9291d039 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:10.422927 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:10.423209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:10.423482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:10.459833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:10.461024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:10.506150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:10.506796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:10.507076 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:10.507348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] PATH_INFO: `/v3/groups/1447cb1ece384a1c9bd805357a152654` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:10.516495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] RBAC: Authorizing `identity:get_group(group_id=1447cb1ece384a1c9bd805357a152654)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:10.518028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:10.521866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 193/380] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:10 2022] GET /identity/v3/groups/1447cb1ece384a1c9bd805357a152654 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:10.534275 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:10.600748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 188/381] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:10.670788 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc7339-5a69-483c-8563-fa28e0dabffb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:10.707262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:10.707875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:10.708153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:10.708424 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:10.709158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] RBAC: Adding query filter params (group.id=1447cb1ece384a1c9bd805357a152654, role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=254545a5250741a0bf9da613f7749ee7) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:10.709464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:10.711012 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:10.717766 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 194/382] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:10 2022] GET /identity/v3/role_assignments?group.id=1447cb1ece384a1c9bd805357a152654&scope.project.id=254545a5250741a0bf9da613f7749ee7&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:11.002504 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:11.118451 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6598f-1646-453c-877f-28ff6a1fec15 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:11.141959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.161279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0fc2e-6085-454b-9fe4-1ca9e69cbdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:11.162343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fc2e-6085-454b-9fe4-1ca9e69cbdcd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:11.162894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fc2e-6085-454b-9fe4-1ca9e69cbdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:11.163366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fc2e-6085-454b-9fe4-1ca9e69cbdcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:11.179775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0fc2e-6085-454b-9fe4-1ca9e69cbdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-4de0fc2e-6085-454b-9fe4-1ca9e69cbdcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:11.187778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:11.188674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:11.189431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:11.191937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 189/383] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:11.198696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:11.248399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.260565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959967be-4f01-48ae-b387-67bdbbe4f256 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:11.260914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959967be-4f01-48ae-b387-67bdbbe4f256 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:11.261265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959967be-4f01-48ae-b387-67bdbbe4f256 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:11.263100 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 190/384] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:11.269015 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:11.269298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:11.269571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:11.295136 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:11.297952 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:11.365698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097575-daa2-4788-aadc-e1955bf9f61f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:11.428055 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 191/385] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:11.429549 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:11.430392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:11.430847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:11.431311 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:11.437688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:11.438229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:11.439875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:11.463473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 195/386] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:11.470623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:11.663201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e492b1-280a-4f76-b97e-5ad3400b2bd4 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:11.680622 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.733964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:11.735079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:11.735573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:11.736049 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:11.743119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:11.746401 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:11.749536 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 192/387] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:11 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:11.757822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:11.885635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:11.919134 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.945783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36df0d-8550-45ce-87a4-7aeacc72cac0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:12.059435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:12.060376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.060792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.061199 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.062502 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:12.064171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:12.080575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 196/388] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:11 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:12.086758 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:12.100925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cb1d7-3254-4e22-b87a-8dd8c631b9e2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:12.149970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:12.149970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.149970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.149970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.169977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:12.175143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:12.176001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:12.176768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:12.185957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 193/389] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:12.203734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:12.252978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:12.308489 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d80d-a5df-475e-ab0f-2cff679b9130 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:12.352214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cfc80-5ffa-4ac0-91f1-820b7535460a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:12.382246 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c3bae-34ef-4366-acae-469adaea4723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:12.382915 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3bae-34ef-4366-acae-469adaea4723 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.383297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3bae-34ef-4366-acae-469adaea4723 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.383574 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3bae-34ef-4366-acae-469adaea4723 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99/groups/4faedc097e9b41598007387a1795c4f7/roles/e724fe5c79a448c48fa8cdbb118400fe` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.386075 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c3bae-34ef-4366-acae-469adaea4723 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a98ceb5527d476588ffaa7358e80a99, group_id=4faedc097e9b41598007387a1795c4f7, role_id=e724fe5c79a448c48fa8cdbb118400fe)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:12.387623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c3bae-34ef-4366-acae-469adaea4723 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:12.419392 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:12.424452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.424452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.424452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.424452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:12.424452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:12.424452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b42ca9-093f-4a6d-9a6f-31223280debd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:12.437024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 194/390] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:12.439870 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68c651-2747-4c69-956f-9ec579545059 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.439870 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68c651-2747-4c69-956f-9ec579545059 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.439870 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68c651-2747-4c69-956f-9ec579545059 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.441000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 195/391] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:12.442005 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68c651-2747-4c69-956f-9ec579545059 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:12.513581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 197/392] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Aug 12 10:59:12 2022] PUT /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99/groups/4faedc097e9b41598007387a1795c4f7/roles/e724fe5c79a448c48fa8cdbb118400fe => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:59:12.515410 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.515968 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.522297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.571289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:12.572698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:12.604546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:12.663816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:12.682276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68c651-2747-4c69-956f-9ec579545059 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:12.725797 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:12.727221 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.727668 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.728109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.730816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:12.732074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:12.733880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 196/393] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:12 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:12.739965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:12.764664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 198/394] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:12.877793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d53b6f-34ae-452a-85ce-473e7081fa48 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:12.931616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589240a9-6eb1-4f3c-91b5-cf479cd37262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:12.932258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589240a9-6eb1-4f3c-91b5-cf479cd37262 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:12.932686 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589240a9-6eb1-4f3c-91b5-cf479cd37262 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:12.932911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589240a9-6eb1-4f3c-91b5-cf479cd37262 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:12.934130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589240a9-6eb1-4f3c-91b5-cf479cd37262 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:12.935584 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589240a9-6eb1-4f3c-91b5-cf479cd37262 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:12.937407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 197/395] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:12 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:12.943441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.051022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3d12-93f0-474f-810f-2ae18771a33b None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:13.093217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:13.093895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.094201 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.094479 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99/groups/4faedc097e9b41598007387a1795c4f7/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.096768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a98ceb5527d476588ffaa7358e80a99, group_id=4faedc097e9b41598007387a1795c4f7, role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:13.098232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:13.178507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 199/396] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Aug 12 10:59:12 2022] PUT /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99/groups/4faedc097e9b41598007387a1795c4f7/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:13.232552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c0741-92de-4fcc-b5ae-9304f4ea2b7e None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.233063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c0741-92de-4fcc-b5ae-9304f4ea2b7e None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.233063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c0741-92de-4fcc-b5ae-9304f4ea2b7e None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.234538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 198/397] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:13.242437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.247194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:13.263925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9486169-14dd-4232-bd27-7857c4a0c452 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.264253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9486169-14dd-4232-bd27-7857c4a0c452 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.264484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9486169-14dd-4232-bd27-7857c4a0c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.296784 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-d9486169-14dd-4232-bd27-7857c4a0c452 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:13.298133 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-d9486169-14dd-4232-bd27-7857c4a0c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:13.349520 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:13.398101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6e3e-0629-43a1-9bc6-0ec3b65e5092 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:13.403907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 199/398] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:13.407657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113414da-d189-4605-8882-a883f682a7ce None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.407657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113414da-d189-4605-8882-a883f682a7ce None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.407657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113414da-d189-4605-8882-a883f682a7ce None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.407657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 200/399] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:13.412691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.412976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.413252 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.433093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:13.434407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:13.476953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:13.477603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.477886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.478879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.502608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:13.508209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:13.509180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:13.510171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:13.513959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 201/400] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:13.514293 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 200/401] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:13.523558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.675101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:13.688603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fa508-581d-4df4-a67f-70258f36eeda None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:13.735475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:13.736455 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.736933 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.737398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.738278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:13.738794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:13.740447 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:13.751822 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 202/402] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:13.757548 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.789513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.851913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:13.902393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564698a4-37bc-4969-8836-2b0c354178be None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:13.904023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3f46-add3-4b05-a509-d8e4ba4534c1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:13.944473 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:13.945398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.945535 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:13.945979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.946168 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:13.946450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:13.946696 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.946810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:13.948583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:13.950300 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:13.952613 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 201/403] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:13 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:13.953632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.959647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:13.965223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:13.966281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:13.967304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:13.969472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 203/404] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:13.970515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:13.987513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.078037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec4b41-fec1-4ed4-9667-7933cb0d5518 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.079626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584203c-051d-4acd-a727-1cd0d445b824 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.115780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.118411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.119079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.119361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.119635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.120902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.122435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.125016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.125016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.125016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.125016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.125311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 204/405] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:13 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.125475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.135910 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:14.140886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:14.141712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:14.142602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:14.145326 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 202/406] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:14.146291 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.232798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.253641 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571dfae-8a9e-46ec-b52a-34ef58afec68 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.255893 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87dae2-6754-469a-b276-acab5959f104 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.291698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.292748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.293348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.294141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.295036 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:14.295650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.297226 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.299138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.299892 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.300270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.300945 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494/groups/4faedc097e9b41598007387a1795c4f7/roles/e724fe5c79a448c48fa8cdbb118400fe` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.303051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] RBAC: Authorizing `identity:create_grant(project_id=131b25681eae48e297bfa8d5c0338494, group_id=4faedc097e9b41598007387a1795c4f7, role_id=e724fe5c79a448c48fa8cdbb118400fe)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.305268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.307919 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 205/407] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.309054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.422956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09b15-bc6d-4626-b4e3-69bf646c4e8a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.438800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 203/408] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Aug 12 10:59:14 2022] PUT /identity/v3/projects/131b25681eae48e297bfa8d5c0338494/groups/4faedc097e9b41598007387a1795c4f7/roles/e724fe5c79a448c48fa8cdbb118400fe => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:14.440212 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.502141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.504725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.505319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.505961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.507560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:14.508349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.511486 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.532503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 206/409] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.538353 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.550823 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.558699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.657616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97638-2525-4ab9-b1ba-2eadf4c1eda6 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.671502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4ed4a-47a0-43f0-b756-508baf88d956 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.704234 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.705321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.705851 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.706295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.708667 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.710393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.710635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.711343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.711695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.712146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] PATH_INFO: `/v3/groups/1447cb1ece384a1c9bd805357a152654` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.713413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 204/410] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:14 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.722002 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] RBAC: Authorizing `identity:get_group(group_id=1447cb1ece384a1c9bd805357a152654)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.722002 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.722002 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 207/411] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:14 2022] GET /identity/v3/groups/1447cb1ece384a1c9bd805357a152654 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.723232 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.723419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.844186 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.876438 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9a8b3-99b9-4156-9e5f-fc8d10993e13 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.899156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ecf6-b2fd-4b18-a205-8227ef4868b9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:14.920172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8a004-b807-4c2e-b4ff-5d1b5dca46a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.920727 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:14.921371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8a004-b807-4c2e-b4ff-5d1b5dca46a8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.921724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8a004-b807-4c2e-b4ff-5d1b5dca46a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.922499 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8a004-b807-4c2e-b4ff-5d1b5dca46a8 None admin] PATH_INFO: `/v3/projects/254545a5250741a0bf9da613f7749ee7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.923940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8a004-b807-4c2e-b4ff-5d1b5dca46a8 None admin] RBAC: Authorizing `identity:get_project(project_id=254545a5250741a0bf9da613f7749ee7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.926174 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8a004-b807-4c2e-b4ff-5d1b5dca46a8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.928907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 208/412] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:14 2022] GET /identity/v3/projects/254545a5250741a0bf9da613f7749ee7 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.930260 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4639e24-1913-42a0-8364-e166597607ed None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.931834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4639e24-1913-42a0-8364-e166597607ed None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.931834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4639e24-1913-42a0-8364-e166597607ed None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.933013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 209/413] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:14.937515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4639e24-1913-42a0-8364-e166597607ed None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:14.943864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d92d7-97e1-47fb-99e5-2c6cc778bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:14.944646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d92d7-97e1-47fb-99e5-2c6cc778bf8c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.945059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d92d7-97e1-47fb-99e5-2c6cc778bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.945412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d92d7-97e1-47fb-99e5-2c6cc778bf8c None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.946670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d92d7-97e1-47fb-99e5-2c6cc778bf8c None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:14.948787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d92d7-97e1-47fb-99e5-2c6cc778bf8c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:14.950759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 205/414] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:14 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:14.952268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:14.952629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:14.953006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:14.973225 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:14.974594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:15.050039 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 206/415] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:15.055917 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:15.071294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4639e24-1913-42a0-8364-e166597607ed None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:15.146042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74828-f0c4-4cd4-bec2-a886aa599971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:15.146717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74828-f0c4-4cd4-bec2-a886aa599971 None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:15.147144 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74828-f0c4-4cd4-bec2-a886aa599971 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:15.147430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74828-f0c4-4cd4-bec2-a886aa599971 None admin] PATH_INFO: `/v3/projects/254545a5250741a0bf9da613f7749ee7/groups/1447cb1ece384a1c9bd805357a152654/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:15.156073 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74828-f0c4-4cd4-bec2-a886aa599971 None admin] RBAC: Authorizing `identity:create_grant(project_id=254545a5250741a0bf9da613f7749ee7, group_id=1447cb1ece384a1c9bd805357a152654, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:15.157541 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74828-f0c4-4cd4-bec2-a886aa599971 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:15.186256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959c0bc-15a0-4887-b6c1-e8926d8b10da None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:15.205822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:15.223717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216978-3571-489c-9dc5-f42066aa38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:15.224315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216978-3571-489c-9dc5-f42066aa38d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:15.224590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216978-3571-489c-9dc5-f42066aa38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:15.224861 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216978-3571-489c-9dc5-f42066aa38d3 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494/groups/4faedc097e9b41598007387a1795c4f7/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:15.227071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b216978-3571-489c-9dc5-f42066aa38d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=131b25681eae48e297bfa8d5c0338494, group_id=4faedc097e9b41598007387a1795c4f7, role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:15.228718 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b216978-3571-489c-9dc5-f42066aa38d3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:15.260113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 210/416] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Aug 12 10:59:14 2022] PUT /identity/v3/projects/254545a5250741a0bf9da613f7749ee7/groups/1447cb1ece384a1c9bd805357a152654/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:15.334427 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 207/417] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Aug 12 10:59:15 2022] PUT /identity/v3/projects/131b25681eae48e297bfa8d5c0338494/groups/4faedc097e9b41598007387a1795c4f7/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:15.334891 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47bf98-259c-4a1e-bc0a-47a446643d73 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:15.335464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47bf98-259c-4a1e-bc0a-47a446643d73 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:15.335972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47bf98-259c-4a1e-bc0a-47a446643d73 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:15.338165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 211/418] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:15.344136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:15.344463 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:15.344689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:15.364359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:15.365581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:15.386169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47bf98-259c-4a1e-bc0a-47a446643d73 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:15.389180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:15.495573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 208/419] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:15.557192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47bf98-259c-4a1e-bc0a-47a446643d73 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:15.601252 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:15.602278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:15.602811 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:15.603353 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:15.617523 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:15.623806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:15.624659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:15.625467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:15.627715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 212/420] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:15.633538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:15.776566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765134e-e4d7-444b-bdcd-e0dd7ade3830 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:15.784200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:15.787059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:15.816029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:15.817115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:15.817828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:15.818771 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:15.819898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:15.820399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:15.823695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:15.834940 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 209/421] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:15.842566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:15.870676 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:15.937469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943a089-8137-4283-831d-0eb1aaeabe8b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.005452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79e733-f656-4540-b0ef-cfe579a54fe3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.018632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.019607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.020098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.020587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.043561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:16.046482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.047094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.047377 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.047649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:16.055092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:16.055960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:16.056841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 213/422] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:16.066881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:16.096619 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:16.127403 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:16.128868 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:16.266661 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871f980-e9ce-4fde-8a49-bbcd7270b117 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.309243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 210/423] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:16.314885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:16.315449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:16.341208 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.341838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.342209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.342489 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.343170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:16.343478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:16.344898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:16.368336 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 214/424] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:16.374090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:16.387101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:16.418904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f71a-01b5-4cf7-98da-d572e33810aa None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.466245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.467243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.467747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.468189 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.469533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:16.471218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:16.473326 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 211/425] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:16 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:16.479651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:16.570903 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3805f-3582-44a0-94b2-73893d2800ef None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.623402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53447558-b02f-42da-a73a-ce4691acaa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.624179 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53447558-b02f-42da-a73a-ce4691acaa06 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.624459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53447558-b02f-42da-a73a-ce4691acaa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.624729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53447558-b02f-42da-a73a-ce4691acaa06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.627092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fa86-cf21-4c90-b2b1-fb8b54a232b1 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.683941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.685653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.686795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.687266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.688788 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:16.691478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:16.694819 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 212/426] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:16 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:16.701665 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:16.719038 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:16.737313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:16.761721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53447558-b02f-42da-a73a-ce4691acaa06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:16.763147 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53447558-b02f-42da-a73a-ce4691acaa06 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:16.843013 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20090522-40e5-45c1-995b-8d370ff360d9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:16.879254 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:16.879875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.880147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.880400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.881116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=0a98ceb5527d476588ffaa7358e80a99) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:16.881420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:16.883209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:16.890908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 215/428] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:59:16.892423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224f17-e222-465f-95e9-8540895310dd None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.892903 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224f17-e222-465f-95e9-8540895310dd None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.893406 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224f17-e222-465f-95e9-8540895310dd None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.895127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 216/429] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:16.899209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 213/429] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:16 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:16.899366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:16.900882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:16.901391 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:16.901858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:16.925585 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:16.927306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:17.022287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:17.066474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 217/430] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:17.095294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf487-f8ab-48bf-aa22-1a48d94b6067 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:17.140120 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:17.140766 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.141052 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.141325 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] PATH_INFO: `/v3/projects/0a98ceb5527d476588ffaa7358e80a99` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.142490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] RBAC: Authorizing `identity:get_project(project_id=0a98ceb5527d476588ffaa7358e80a99)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:17.143925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:17.145624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 214/431] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:16 2022] GET /identity/v3/projects/0a98ceb5527d476588ffaa7358e80a99 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:17.151745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:17.172124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:17.271687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c17e0-d1e5-4004-a52e-51b3384bd7e6 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:17.317789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:17.318481 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.318763 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.319034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.321068 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:17.322644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:17.324534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 218/432] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:17 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:17.330465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:17.424461 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:17.446439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ff48-cdf5-469b-ac6e-7d12bda6d8bb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:17.491437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:17.492067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.492349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.492623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.493363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=0a98ceb5527d476588ffaa7358e80a99) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:17.493714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:17.495625 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4f064-a6fa-49c0-8866-9ea2d35d9c27 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:17.502825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 215/433] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:17 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=0a98ceb5527d476588ffaa7358e80a99&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:17.522187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f57b7-fe7b-46e9-af18-fe150a701e80 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.522496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f57b7-fe7b-46e9-af18-fe150a701e80 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.522803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f57b7-fe7b-46e9-af18-fe150a701e80 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.524571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 216/434] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:17.531101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce91ac-f0a1-4247-b91f-b595faeb9c1d None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.531455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce91ac-f0a1-4247-b91f-b595faeb9c1d None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.531653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce91ac-f0a1-4247-b91f-b595faeb9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.539735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:17.552585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-2dce91ac-f0a1-4247-b91f-b595faeb9c1d None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:17.553790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-2dce91ac-f0a1-4247-b91f-b595faeb9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:17.554299 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:17.577849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5bc7-a1c4-4df8-a8c9-62fa273342c6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:17.618765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:17.619526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.619817 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.620097 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.640428 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:17.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:17.646516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:17.647319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 219/435] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:17.654389 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:17.656760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 217/436] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:17.683042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd49d-5fdd-48bc-9b64-7fe9a0bc3782 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.683532 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd49d-5fdd-48bc-9b64-7fe9a0bc3782 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.684012 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd49d-5fdd-48bc-9b64-7fe9a0bc3782 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.685801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 218/437] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:17.693958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.694238 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.694511 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.719576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:17.721400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:17.802278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7596-3a80-42ee-82c3-ee1022803701 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:17.814161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 219/438] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:17.842703 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:17.843307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:17.843584 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:17.843855 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:17.844500 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] RBAC: Adding query filter params (name=member) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:17.844807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:17.846200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:17.855087 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 220/439] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 10:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:17.860596 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:17.927797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:17.946808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:17.952008 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:17.977063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42bdc0-1b28-4442-9485-ca94360c5dbe None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.027757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.028378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.028657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.028927 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.075322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45585c88-013a-4710-bfa1-c8791d2a2458 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.103971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.105464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.110370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.111004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.111287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.111562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.122347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:18.127505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:18.128404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:18.129173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 221/440] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:18.129797 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.165972 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.191090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.209459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 220/441] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:18.209459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.229078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0e23-bd1b-4084-8e23-f3c386ed3a9e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.262698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.263324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.263612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.263885 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.273662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:18.278772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:18.279678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:18.280468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 222/442] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:18.281113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.307701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907c0e-607c-4dff-9738-503cab57f0bb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.340713 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.341325 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.341642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.341933 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.342609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:18.342914 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.344292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.352203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 221/443] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:18.353606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.378781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.383681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9cb4-3821-4bc8-a5c9-c824fb329c6e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.407462 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.418227 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.418847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.419124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.419395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.420512 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.421977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.423580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 223/444] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:18.424337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.456816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700459e-cd60-4ec4-9631-fcb39f7f8212 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.490909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.491464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.491746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.492019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.492733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:18.493040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.495031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.502788 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 222/445] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:18.503727 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.529701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82674a5-80ac-4b1c-b7e9-feb13bb9ac1d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.562848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.563440 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.563720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.563992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.587749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.601898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329ad9f-39c0-4f2a-b57a-9e7ad264b7e4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.623375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.632538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.634028 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.636608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.637235 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.637512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.637787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.638965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.640423 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.642158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 223/446] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:18.642898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.731428 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 224/447] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:18.732260 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.740903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c909-52ef-4787-a62d-41cf56e4b4d0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.774150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.774751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.775227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.775502 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.798766 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.819410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:18.828160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710aebd-f54e-480e-98d8-3f2fab0522f8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:18.842693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.844254 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.861606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:18.862224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:18.862500 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:18.862766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:18.863477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=e724fe5c79a448c48fa8cdbb118400fe, scope.project.id=131b25681eae48e297bfa8d5c0338494) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:18.863781 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:18.865187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:18.871739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 225/448] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=e724fe5c79a448c48fa8cdbb118400fe => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:18.872331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.966942 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 224/449] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:18.972940 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:18.997294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67574-1ad7-4243-aee7-3e3471df3f04 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:19.037125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:19.037700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:19.037808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:19.038003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:19.038247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] PATH_INFO: `/v3/projects/254545a5250741a0bf9da613f7749ee7` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:19.040261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] RBAC: Authorizing `identity:get_project(project_id=254545a5250741a0bf9da613f7749ee7)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:19.042840 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:19.044494 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 226/450] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/projects/254545a5250741a0bf9da613f7749ee7 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:19.050892 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:19.081967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:19.092714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf45b2-517e-4ffa-918f-506092c9b916 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:19.134964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:19.136278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:19.136278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:19.136278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] PATH_INFO: `/v3/projects/131b25681eae48e297bfa8d5c0338494` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:19.137427 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] RBAC: Authorizing `identity:get_project(project_id=131b25681eae48e297bfa8d5c0338494)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:19.140904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:19.141692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 225/451] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 10:59:18 2022] GET /identity/v3/projects/131b25681eae48e297bfa8d5c0338494 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:19.146768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:19.167824 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5831-7fe6-4e7b-a8e6-3d026d3bebc0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:19.207983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:19.208737 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:19.209022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:19.209296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] PATH_INFO: `/v3/groups/1447cb1ece384a1c9bd805357a152654` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:19.210620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] RBAC: Authorizing `identity:get_group(group_id=1447cb1ece384a1c9bd805357a152654)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:19.212100 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:19.215362 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 227/452] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:19 2022] GET /identity/v3/groups/1447cb1ece384a1c9bd805357a152654 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:19.223274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:19.263599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ae4b-fd77-4fc7-9f89-0fb3ec0dba53 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:19.285326 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:19.296761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:19.297326 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:19.297602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:19.297869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] PATH_INFO: `/v3/groups/4faedc097e9b41598007387a1795c4f7` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:19.299014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] RBAC: Authorizing `identity:get_group(group_id=4faedc097e9b41598007387a1795c4f7)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:19.300454 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:19.302029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 226/453] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Aug 12 10:59:19 2022] GET /identity/v3/groups/4faedc097e9b41598007387a1795c4f7 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:19.308364 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:19.320695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:19.329747 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18034-25c9-44c5-88b2-d3fbb02779d0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:19.362117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:19.362716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:19.362993 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:19.363284 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:19.363999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] RBAC: Adding query filter params (group.id=1447cb1ece384a1c9bd805357a152654, role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=254545a5250741a0bf9da613f7749ee7) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:19.364301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:19.365721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88b22-5ce6-40a8-82ac-76ea006869d8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:19.371761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 228/454] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:19 2022] GET /identity/v3/role_assignments?group.id=1447cb1ece384a1c9bd805357a152654&scope.project.id=254545a5250741a0bf9da613f7749ee7&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:19.409489 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1e21-5adc-405c-80de-8f14c955811f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:19.446306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:19.447504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:19.447783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:19.448053 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:19.448789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] RBAC: Adding query filter params (group.id=4faedc097e9b41598007387a1795c4f7, role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=131b25681eae48e297bfa8d5c0338494) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:19.449095 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:19.450679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b2b85-5946-482d-bc36-8598a1b48d86 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:19.457115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 227/455] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Aug 12 10:59:19 2022] GET /identity/v3/role_assignments?group.id=4faedc097e9b41598007387a1795c4f7&scope.project.id=131b25681eae48e297bfa8d5c0338494&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:22.026464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab18c4-d6ff-4974-bee3-be45a1b4c56e None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.027481 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab18c4-d6ff-4974-bee3-be45a1b4c56e None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.027963 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab18c4-d6ff-4974-bee3-be45a1b4c56e None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.029721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 229/456] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:22.035328 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5376-f768-4da6-a66c-bad064142302 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.036108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5376-f768-4da6-a66c-bad064142302 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.036592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5376-f768-4da6-a66c-bad064142302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.056863 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-41ba5376-f768-4da6-a66c-bad064142302 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:22.058816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-41ba5376-f768-4da6-a66c-bad064142302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:22.109137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049257d6-c5a4-4c3c-ad27-87b28c0ef2d9 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.109770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049257d6-c5a4-4c3c-ad27-87b28c0ef2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.110279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049257d6-c5a4-4c3c-ad27-87b28c0ef2d9 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.111809 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 230/457] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:22.116942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.117453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.117935 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.124917 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:22.143877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 228/458] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:22.150898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:22.152304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:22.168301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c503a-de20-4ba9-b0f1-5c9af0c030af None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.168573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c503a-de20-4ba9-b0f1-5c9af0c030af None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.168852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c503a-de20-4ba9-b0f1-5c9af0c030af None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.170326 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 229/459] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:22.176276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.176551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.176818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.195027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:22.196204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:22.262535 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 231/460] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:22.284680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 230/461] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:22.497031 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:22.582902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:22.602728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:22.618538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10ac48-d9d4-49b5-a626-ea6287166aba None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:22.667181 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:22.667836 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.668118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.668405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.679825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:22.682241 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:22.698671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:22.699587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:22.700418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:22.700418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:22.700418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:22.704328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 232/462] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:22.705189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:22.716483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386122a-d7a8-44df-a929-d46f3d73a2fc None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:22.732072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:22.754568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:22.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.755538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.755811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.767974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:22.769526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:22.785256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:22.787649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:22.789760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:22.789760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:22.789760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:22.789760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 231/463] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:22.789760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:22.813072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaed0-8b27-46dd-9b68-04a80ce563eb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:22.847401 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:22.847956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.848234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.848539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.856659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:22.860396 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:22.862325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:22.879522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:22.880430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:22.881249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:22.881249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:22.881249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:22.881249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 233/464] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:22.881461 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:22.902248 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917136e6-e62c-44eb-b284-3e25abf2e93f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:22.939093 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:22.939730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.939979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.940249 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.940891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:22.941191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:22.942580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd36943-de66-4dff-af02-cc95c6b5bf3f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:22.959930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 232/465] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:22.959930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ec75-9f29-42c9-a74e-ecbb7287f3b5 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:22.959930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ec75-9f29-42c9-a74e-ecbb7287f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:22.959930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ec75-9f29-42c9-a74e-ecbb7287f3b5 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:22.959930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 233/466] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:22.959930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ec75-9f29-42c9-a74e-ecbb7287f3b5 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:22.988929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:22.996327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3df64b-3c9d-46d2-ab95-8f7360bb776d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.036907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.038249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.038703 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.039177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.039992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:23.041282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.042923 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.066269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ec75-9f29-42c9-a74e-ecbb7287f3b5 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.067349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 234/467] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:23.068333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:23.102161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.102784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.103716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.104001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.104666 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:23.104974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.106387 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ab48-02c5-4e5c-9f44-6997cea6cda6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 234/468] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:23.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.128806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:23.138278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:23.139668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:23.184318 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e308-fb7a-4a39-829d-113d3ca0154e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.217978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 235/469] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:23.217978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:23.227594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.228823 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.229171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.229513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.230370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.232011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.237707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:23.321941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd147-4a82-4a59-b64f-08613efd4800 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.350788 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 235/470] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:59:23 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:23.352030 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:23.384045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.386513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.387261 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.388890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.390354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.392072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.508022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd4c7-f521-45f9-aaa4-1298390fb5ae None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.516884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 236/471] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:59:23 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:23.517430 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:23.528037 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:23.559091 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a4c5-060b-4881-8199-39e7d67fbc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.559972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a4c5-060b-4881-8199-39e7d67fbc4e None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.560429 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a4c5-060b-4881-8199-39e7d67fbc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.560918 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a4c5-060b-4881-8199-39e7d67fbc4e None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.561592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a4c5-060b-4881-8199-39e7d67fbc4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.563134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a4c5-060b-4881-8199-39e7d67fbc4e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.619887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:23.654856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e627-42d4-47b5-b13b-8c035230ff41 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.683472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 236/472] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:59:23 2022] POST /identity/v3/users => generated 246 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:23.685116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098caf7-26d9-493b-8666-56e9ec84a831 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.686298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098caf7-26d9-493b-8666-56e9ec84a831 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.686803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098caf7-26d9-493b-8666-56e9ec84a831 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.689333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 237/473] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:23.695556 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.700719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.700719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.707261 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.708436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.708939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.709404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.717528 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:23.718936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:23.725594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.727553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:23.747607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:23.748757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:23.749786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:23.749786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:23.749786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:23.749786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 237/474] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:23.756299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:23.808293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 238/475] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:23.876757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c37e-8994-4832-bbbc-55f82846a3eb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:23.902466 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:23.914482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:23.915768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:23.916501 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:23.916969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:23.917812 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:23.918282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:23.919849 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:23.934209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 238/476] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:23.939669 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:24.036842 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:24.046783 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0401-42ac-456e-8c64-88a88e6bfcc1 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:24.083273 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:24.084173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:24.084610 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:24.085067 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:24.098694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:24.098694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:24.108136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:24.201148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 239/477] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:59:23 2022] POST /identity/v3/users => generated 249 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:59:24.235043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d0914-c209-4c78-9910-14c7e73db2ef None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:24.275635 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:24.276652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:24.277180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:24.277652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:24.278535 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:24.280329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:24.348783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.sql.core [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 10:59:24.348783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 10:59:24.348783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [parameters: {'id': 'd0ed46f3143b416a8e6e1e75cb4222e7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 10:59:24.348783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81712) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result.read() Aug 12 10:59:24.367811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return ref.to_dict() Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:59:24.368795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application yield resource Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise self.value Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application session.commit() Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 10:59:24.369657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.session.flush() Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application compat.raise_( Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 10:59:24.370565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:59:24.371663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result.read() Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:59:24.372610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [parameters: {'id': 'd0ed46f3143b416a8e6e1e75cb4222e7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:24.373567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 10:59:24.374621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:24.377420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 239/478] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Aug 12 10:59:24 2022] POST /identity/v3/roles => generated 144 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:24.382979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:24.497492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1d5b-2365-4959-878d-10ca7fb75023 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:24.538090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ebeac-d793-4b6c-9c7f-1fe1412e570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:24.538739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ebeac-d793-4b6c-9c7f-1fe1412e570e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:24.539022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ebeac-d793-4b6c-9c7f-1fe1412e570e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:24.539297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ebeac-d793-4b6c-9c7f-1fe1412e570e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:24.552257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ebeac-d793-4b6c-9c7f-1fe1412e570e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-363ebeac-d793-4b6c-9c7f-1fe1412e570e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:24.558487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:24.560109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:24.562320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 240/479] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 10:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:24.565696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:24.624795 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:24.682035 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462392b-4234-4b23-ba03-52d116f9c0e4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:24.718759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:24.719721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:24.720195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:24.720679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:24.721521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:24.722053 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:24.723617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e4f6-c965-4ec1-849f-7a6f7726ce07 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:24.732026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 240/480] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:25.590733 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38dc9-bb7c-4d6e-be23-01adab91b2aa None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:25.591766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38dc9-bb7c-4d6e-be23-01adab91b2aa None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:25.592259 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38dc9-bb7c-4d6e-be23-01adab91b2aa None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:25.594210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 241/481] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:25.599100 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674aa76-49e5-45ef-9818-63d55d80700e None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:25.599894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674aa76-49e5-45ef-9818-63d55d80700e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:25.600377 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674aa76-49e5-45ef-9818-63d55d80700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:25.626391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f674aa76-49e5-45ef-9818-63d55d80700e None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:25.627902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f674aa76-49e5-45ef-9818-63d55d80700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:25.716834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 241/482] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:26.155326 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8050-3c88-4079-be59-a57698dd3f4c None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.155692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8050-3c88-4079-be59-a57698dd3f4c None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.155897 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8050-3c88-4079-be59-a57698dd3f4c None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.157469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 242/483] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:26.162595 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc526-a230-4b9b-ad88-ce641f5adfd2 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.162888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc526-a230-4b9b-ad88-ce641f5adfd2 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.163160 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc526-a230-4b9b-ad88-ce641f5adfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.183803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8050-3c88-4079-be59-a57698dd3f4c None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:26.186776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-0e3fc526-a230-4b9b-ad88-ce641f5adfd2 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:26.187974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-0e3fc526-a230-4b9b-ad88-ce641f5adfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:26.201320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:26.241013 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:26.280497 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 242/484] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:26.281953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f70e-8d35-4c48-8a69-5f7e4eb57f62 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.282365 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f70e-8d35-4c48-8a69-5f7e4eb57f62 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.282746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f70e-8d35-4c48-8a69-5f7e4eb57f62 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.284338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 243/485] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:26.294828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.295369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.295765 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.328370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:26.330392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:26.363519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8050-3c88-4079-be59-a57698dd3f4c None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:26.423409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 244/486] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:26.428009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:26.428652 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.428931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.429202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.440365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:26.446098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:26.448705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:26.450736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 243/487] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:26.454979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:26.589348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:26.592874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc8119-995d-4b00-9531-620ff807ff6b None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:26.604212 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:26.628881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:26.629486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.629767 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.630073 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.630841 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:26.631254 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:26.632646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:26.642182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 245/488] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:26.647768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:26.722992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:26.762109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d2376-eb81-49bb-8be3-a0e0c67339d7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:26.799137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576780-b016-4097-b891-22285e661533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:26.800171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576780-b016-4097-b891-22285e661533 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.800721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576780-b016-4097-b891-22285e661533 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.801000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576780-b016-4097-b891-22285e661533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.805474 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1efb4-6023-4533-9e1b-729c0928fefa None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:26.814720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576780-b016-4097-b891-22285e661533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1c576780-b016-4097-b891-22285e661533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:26.822740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:26.823650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:26.824423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:26.830170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 244/489] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:26.830170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1038457-e740-4bfd-b403-27d1ef0d025b None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.830170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1038457-e740-4bfd-b403-27d1ef0d025b None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.830170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1038457-e740-4bfd-b403-27d1ef0d025b None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.830170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 245/490] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:26.831373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1038457-e740-4bfd-b403-27d1ef0d025b None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:26.845074 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:26.846065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.846492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.846923 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.858399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:26.860092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:26.875570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:26.876481 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:26.877312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:26.877312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:26.877312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:26.877312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 246/491] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:26.878385 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:26.899865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:26.940790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1038457-e740-4bfd-b403-27d1ef0d025b None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:26.972009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:26.982289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a17da-484c-4fde-87e1-993b2462597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:26.982852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a17da-484c-4fde-87e1-993b2462597a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:26.983289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a17da-484c-4fde-87e1-993b2462597a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:26.983564 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a17da-484c-4fde-87e1-993b2462597a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:26.989593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e3a4-deb8-4c59-9619-b73052e67088 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:26.997433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a17da-484c-4fde-87e1-993b2462597a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-146a17da-484c-4fde-87e1-993b2462597a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:27.003806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:27.004698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:27.005493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:27.012077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 246/492] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:27.012077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.012077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.012077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.025126 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.025739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.026044 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.026318 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.026983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:27.027286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.028702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.029411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:27.030673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:27.041882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 247/493] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:27.041882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.109983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 247/494] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:27.109983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.127649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.157744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314da0-ecfa-4305-a906-16292a12ba56 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.205579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.206807 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.207690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.208148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.208978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:27.209480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.211752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.224691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ba37b-3215-40db-a015-80068cce33e9 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.234546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 248/495] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:27.236880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.248347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.266446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.267057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.267546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.268297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.269170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:27.269908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.271706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.285181 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 248/496] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:27.285181 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.366817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c97c9-9f0b-4e6f-a834-8e93ded32a66 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.397829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa429a3-fea7-4cca-b13c-4e54b51fa6e1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.406074 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.406710 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.406993 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.407269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.411628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.420575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.422087 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.435021 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.435612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.435897 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.436173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:27.437435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:27.438292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:27.439798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:27.439798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:27.439798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:27.439798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 249/497] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:27.439798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.446253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.448763 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-a02bad2c-4745-44c9-9264-3df4d7635601 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:27.463692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:27.464775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:27.465889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 249/498] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:27.466574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984ca1-c7f9-49a2-9158-ec88c61a3f67 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.466574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984ca1-c7f9-49a2-9158-ec88c61a3f67 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.466574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984ca1-c7f9-49a2-9158-ec88c61a3f67 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.467843 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 250/499] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:27.468399 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984ca1-c7f9-49a2-9158-ec88c61a3f67 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.512103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.547667 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31ff50-b042-4be5-99d2-cda3a9e0c89e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.569440 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984ca1-c7f9-49a2-9158-ec88c61a3f67 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.583381 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.584013 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.584294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.584569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.595160 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.596635 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.604590 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.605212 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.605494 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.605770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:27.611228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:27.612079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:27.612900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:27.612900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:27.612900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:27.612900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 250/500] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:27.613239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.621489 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:27.626650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:27.627492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 251/501] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:27.629029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.657719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.715799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ed4d-e931-412e-92aa-030caea21366 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.725573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.729155 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00759bc1-0dd4-4805-b15d-a5ae7bd8844a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.749784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.750413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.750695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.750971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.751597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:27.751900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.753269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ec81c-6e73-4f48-9895-37f0fb55b337 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.762034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.762698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.762917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.763189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.763909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:27.764214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.765569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 251/502] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:27.765668 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.766770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.767053 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.767337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.785123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:27.786342 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:27.802992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 252/503] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:27.803820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.855947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 252/504] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:27.856777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.904293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9de11-6f5b-4a92-9f78-c47f3f4c0d86 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:27.905893 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.939021 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:27.939859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:27.940279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:27.940716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:27.941508 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:27.941807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:27.943257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:27.960333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 253/505] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:27.960333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:27.980316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:27.980457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1f02-5b6b-488d-8d94-70bd242baf99 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.016619 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.017151 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.017429 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.017693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.018386 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:28.018684 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.020054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.028796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 253/506] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:28.029402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.077341 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6450-a2e0-467f-a41a-cdf361751235 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.112371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.112996 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.113278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.113558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.122689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.124143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.124776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.133041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4e595-984c-4c41-9622-f337113ed6fc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:28.137029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:28.138350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 254/507] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:28.139253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.169115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.169718 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.170025 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.170303 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.216186 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.237645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf725c77-5a5d-4120-8c74-a985c6138134 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.238967 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.240432 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.271201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.271761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.272048 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.272320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.280352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.281784 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:28.293565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:28.294673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 255/508] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:28.295548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.328951 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.338562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 254/509] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:28.339370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.394198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a111ac-4053-4809-9189-d4b40e5a1c19 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.427534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.428145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.428421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.428688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.435509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.438275 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01e2e-8b6d-495a-9dc3-3e727d535ce2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.439710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.441145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:28.455373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:28.456350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:28.457192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:28.457192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:28.457192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:28.457192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 256/510] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:28.457399 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.475844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.476475 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.476756 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.477029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.487386 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.488824 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:28.502832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:28.503890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:28.504925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:28.504925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:28.504925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:28.504925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 255/511] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:28.504925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.549198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.560463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d539a-24ed-4a83-b3bd-89525d566f21 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.593519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.594262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.594559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.594810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.595558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:28.595861 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.597279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.603891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a21c-e048-4930-80d5-a994b8b8db97 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.614587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 257/512] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:28.615379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.637456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.638165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.638512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.638787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.639508 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:28.639810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.641232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.666770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.676775 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 256/513] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:28.677661 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.719403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2d3bd-8d22-41fb-af83-600dc5a17319 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.759476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.760293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.760733 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.761168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.773324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.776021 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.781885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07cd8-757c-43f1-a50a-8c5540796bf8 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.783420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:28.792402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:28.802245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:28.803290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:28.803290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:28.803290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:28.803290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 258/514] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:28.803290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.816579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.817190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.817464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.817739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.818440 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:28.818743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.820123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.832161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 257/515] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:28.832955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.891816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:28.894919 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3468f-b902-49e6-8be6-c5a760d8b40d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.930285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.931479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.931753 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.932013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:28.932503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424dcf-f6a6-44c0-a647-f63c659e6153 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:28.932650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:28.932951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:28.934361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:28.945847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 259/516] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:28.946727 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:28.970629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:28.971234 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:28.971515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:28.971786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.001766 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.039601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.042257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.043560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4d45-6992-4bc8-992a-e1b2bed800f4 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.076145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.076670 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.076948 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.077216 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.105118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.138398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 258/517] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:29.139225 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.144486 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.145989 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.201006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.238783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27197cfc-fdee-4e72-aa93-ba99118d6b5b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.243985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 260/518] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:29.244936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.271779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.272381 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.272656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.272925 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.273562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:29.273859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.275782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.287399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 259/519] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:29.288156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.303128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.343277 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc6b3c-0bb8-4742-8380-b58099037399 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.376898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.377515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.377791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.378094 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.385003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.386501 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.389146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a44e-ac60-4e29-bcae-2ba4ca65a63a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:29.397553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:29.398546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 261/520] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:29.399524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.415624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.427203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.428799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.428799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.428799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.429060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.430674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.502253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb689b5-8c4e-4a1b-8081-fde1592a64d6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.514198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 260/521] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:59:29 2022] POST /identity/v3/users => generated 247 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:29.515022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.524527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.541662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.542552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.542835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.543108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.556775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.558315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:29.574957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:29.576189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:29.577322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:29.577322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:29.577322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:29.581012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 262/522] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:29.582100 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.643066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81541889-e498-4c40-b174-917b5251bca4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.687378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.688029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.688285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.688558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.702958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.705061 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.707246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d61e3-58fe-47d2-b37f-f4c572359cdb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:29.722420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:29.723351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:29.724177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:29.724177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:29.724177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:29.724177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 261/523] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:29.724390 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.748668 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.749402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.749687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.750001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.756918 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.758398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.762132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:29.770394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:29.777467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 263/524] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:29.778324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.815486 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:29.835417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb2df0-125b-44d1-b0ae-48f0473f0386 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.871291 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.871902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.872185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.872456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.873186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:29.873492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.874985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.888019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681d2d-2aab-48bb-aedf-c1e324c3fee8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:29.896877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 262/525] 10.222.0.40 () {56 vars in 1139 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:29.896877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.929289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:29.929889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:29.930197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:29.930465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:29.931625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:29.931928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:29.933294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:29.949703 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 264/526] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:29.949703 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:29.994232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.011042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68625aee-3b01-42c4-8553-b1af093d4990 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.041007 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.049304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.049947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.050228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.050384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265022-7921-4d37-874b-96e0227e4dad None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.050509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.051145 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:30.051448 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.052858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.064660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 263/527] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:30.065308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.090386 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.090991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.091272 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.091543 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.092246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:30.092552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.093997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.112063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 265/528] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:30.112871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.184266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf799d17-1d79-49cf-800f-af8bfd208384 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.221868 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.222712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.222831 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56be23-5faf-4097-8f6b-04db6e8696ae None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.223043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.223317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.247409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.260415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.261044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.261424 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.261687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.268519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.270004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:30.281848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:30.282787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:30.283616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 266/529] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:30.284450 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.302790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.308702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.310184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.389830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c007f3-5bb0-40dc-bddd-cec040448bdf None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.424752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 264/530] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:30.424752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.430370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.431590 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.431972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.432261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.439776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.441383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:30.456059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:30.456906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:30.457732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 267/531] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:30.458579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.483634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.534545 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.538648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d35d-82ca-404f-8ff7-ce30471d6166 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.567409 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679878c-384d-4b37-a4bf-1c06ce14e707 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.573738 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.574384 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.574661 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.574936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.575664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=750b5024846749d88f240449d6fe0dc3) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:30.575971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.577425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.590317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 265/532] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/role_assignments?user.id=750b5024846749d88f240449d6fe0dc3&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:30.591313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.609454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.610351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.610550 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.610759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.611480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:30.611790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.613302 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.629407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 268/533] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:30.630562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.708797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df8e47-8c11-4ef8-838f-a2c2d4f3dd17 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.724363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.751347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e3743-b943-465c-a8f6-53b65748c766 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.754811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.755668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.756141 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.756623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.768869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.770717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.783994 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:30.786306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:30.787181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:30.788000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:30.788000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:30.788000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:30.788000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 266/534] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:30.788207 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.793872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.794763 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.798027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.798027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.798027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:30.798027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.798027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.814999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 269/535] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:30.816506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.894644 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9570c-3709-4e2a-bc54-2beb50322d75 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.931929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:30.932619 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:30.932957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:30.933277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:30.934050 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=5175fc19ac5f492ea6bd5449ee92dd8f) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:30.934361 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:30.935800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:30.941657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 267/536] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/role_assignments?user.id=5175fc19ac5f492ea6bd5449ee92dd8f&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:30.942666 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:30.947427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54574-c85b-43cc-9a1d-73cd57d08076 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:30.990043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:31.012710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:31.013340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.013694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.013986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.014644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:31.014945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:31.017089 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:31.044860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 270/537] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:31.050280 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:31.120133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca68c4-dd53-4ac8-98a1-f4817619ac8f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:31.137705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:31.163252 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:31.163877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.164159 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.164425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.165756 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=eb9bed06ddf345e7aa00bde7a8ad770b) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:31.166335 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:31.167781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:31.179281 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 268/538] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:30 2022] GET /identity/v3/role_assignments?user.id=eb9bed06ddf345e7aa00bde7a8ad770b&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:31.190269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77778-378e-46c2-81b2-df672ce7abfd None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:31.231434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:31.232076 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.232356 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.232625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.240314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:31.241764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:31.254570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:31.255456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:31.256269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 271/539] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:31.262329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:31.398349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:31.402345 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056ecd-b156-4d1e-bfdd-27f747b52ffe None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:31.439775 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:31.440242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.440520 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.440786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.441546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:31.441856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:31.443340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994a70-ead2-4486-af38-774685971f05 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:31.474143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:31.474436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 269/540] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:31.616036 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf1d6-5aa1-434d-b7fd-a25eedca39af None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:31.635419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:31.653339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c777678-1d3b-443b-bec6-43e69711f509 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.653634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c777678-1d3b-443b-bec6-43e69711f509 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.653891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c777678-1d3b-443b-bec6-43e69711f509 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.655541 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 270/541] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:31.660073 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.660352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.660626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.663089 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:31.663936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:31.664415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:31.664925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:31.665852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=86a3eb0257f242fb806b19b9b9e5f3ec) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:31.666659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:31.668299 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:31.678114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 272/542] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:31 2022] GET /identity/v3/role_assignments?user.id=86a3eb0257f242fb806b19b9b9e5f3ec&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:31.692440 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:31.693677 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:31.783851 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 271/543] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:32.140071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:32.297770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6bb4-7473-4baf-b372-7894274d20ff None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:32.340328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:32.341283 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:32.341709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:32.342154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:32.361077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:32.366617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:32.367673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:32.369159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:32.376226 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 273/544] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:32.377720 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:32.474520 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:32.495438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547db84b-973c-4bd2-bc9a-e8e955ee6a1e None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:32.531585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:32.532199 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:32.532482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:32.532757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:32.533425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:32.533728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:32.535142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:32.545206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 272/545] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:32.550830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:32.609003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:32.689661 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251f63-032a-450b-bd3b-989890bbe818 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:32.725606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:32.726496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:32.726933 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:32.727528 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:32.738192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:32.739832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:32.755247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:32.756254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:32.757245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:32.757245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:32.757245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:32.759062 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 274/546] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:32.765946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:32.934683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876bcb9-3a24-4134-b91b-b56dca4a3a6d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:32.982743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:32.983299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:32.983586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:32.983862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:32.984529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:32.984834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:32.986256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434471d-74c8-4101-a8e3-ac0acdfe7e00 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:33.001014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 273/547] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:33.006622 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:33.063114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2233-56e6-4f6c-9bf8-1143472a5219 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.063430 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2233-56e6-4f6c-9bf8-1143472a5219 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.063676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2233-56e6-4f6c-9bf8-1143472a5219 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.065143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 274/548] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:33.071981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577f0a9-d8f4-4d09-b00b-5187b5fb4d29 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.072587 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577f0a9-d8f4-4d09-b00b-5187b5fb4d29 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.073264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577f0a9-d8f4-4d09-b00b-5187b5fb4d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.082542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:33.095901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-d577f0a9-d8f4-4d09-b00b-5187b5fb4d29 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:33.097399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-d577f0a9-d8f4-4d09-b00b-5187b5fb4d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:33.174121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 275/549] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 12 10:59:33.210288 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:33.233285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e95f0-4382-4220-9fca-869e6dbce3e1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:33.295193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:33.295823 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.296107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.296383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.307192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:33.308639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:33.317902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53c53-fb9e-4bf0-9e0f-7fe4c44f3c51 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.318467 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53c53-fb9e-4bf0-9e0f-7fe4c44f3c51 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.318956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53c53-fb9e-4bf0-9e0f-7fe4c44f3c51 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.320927 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 276/550] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:33.327130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.327615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.328086 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:33.331194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:33.332071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:33.332958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:33.334116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 275/551] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:33.338917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:33.353813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:33.355725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:33.432410 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 277/552] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:33.514569 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc6fcd-2c10-453e-80e1-1a83734497ab None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:33.516136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:33.556356 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:33.558940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.559671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.561206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.562192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:33.562892 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:33.565173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:33.607943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 276/553] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Aug 12 10:59:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:33.610587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:33.635795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:33.648208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:33.694817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd191fb-ed9a-4915-b937-2782a659b537 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:33.736846 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5d86d-626f-4a33-aecb-b52dca1199df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:33.737883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5d86d-626f-4a33-aecb-b52dca1199df None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.738190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5d86d-626f-4a33-aecb-b52dca1199df None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.738752 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5d86d-626f-4a33-aecb-b52dca1199df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.743902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63bb03-6917-40f6-8176-f182fe557eab None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:33.751370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5d86d-626f-4a33-aecb-b52dca1199df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4db5d86d-626f-4a33-aecb-b52dca1199df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:33.758289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:33.759715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:33.760857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 278/554] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:33.762187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbde4-cba9-4c25-a44b-19a401b4ae3d None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.762187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbde4-cba9-4c25-a44b-19a401b4ae3d None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.762360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbde4-cba9-4c25-a44b-19a401b4ae3d None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.765785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 279/555] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:33.767892 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fbde4-cba9-4c25-a44b-19a401b4ae3d None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:33.792602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:33.793211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.793498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.793795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.866839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:33.868494 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:33.876911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:33.880583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fbde4-cba9-4c25-a44b-19a401b4ae3d None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:33.904691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:33.915635 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:33.916607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.916989 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.917267 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.917964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:33.918299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:33.919694 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4984d5e-a922-46a4-9e24-b2137f3f5426 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:33.933271 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 280/556] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:33.934830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:33.935356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:33.935356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:33.954908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:33.956112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:33.980972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 277/557] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:33.980972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.029383 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 281/558] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:34.030646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.097242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b785fc-ecaa-40da-ba67-f45e7062fbca None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.105503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.135233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.135858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.136137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.136411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.140616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717538a7-f32a-4bf8-8bf8-9715557ade19 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.146597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:34.151319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.152395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:34.153368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:34.157198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 278/559] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.158045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.161774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.181768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.182757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.183190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.183469 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.194396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.195850 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e7109e00-9668-493a-a461-029cc91c1698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:34.211434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.212947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:34.213807 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:34.213807 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:34.213807 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:34.217218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 282/560] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.218458 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637a7e-a831-4fbe-9953-fc109a73a09a None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.218737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637a7e-a831-4fbe-9953-fc109a73a09a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.219008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637a7e-a831-4fbe-9953-fc109a73a09a None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.220398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 283/561] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:34.224806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637a7e-a831-4fbe-9953-fc109a73a09a None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.262511 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995193-b8ed-4a8e-9183-fd7ad5f74707 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.296644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.297191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.297468 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.297736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.308622 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.310115 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:34.324315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.325423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:34.326337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:34.326337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:34.326337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:34.326337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 279/562] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.326337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.344271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.365144 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637a7e-a831-4fbe-9953-fc109a73a09a None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.398105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.398701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.398978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.399302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.399958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:34.400256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.401618 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45447e31-8d98-47a9-a4ba-85dea9198ecf None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.409412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 284/563] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:34.410596 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.410882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.411154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.428638 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:34.428785 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5bfa-54fc-4ebb-9cd1-bbe600eb3d7a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.429813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:34.456995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.463315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.463922 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.464202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.464474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.465117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:34.465418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.466813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.478611 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 280/564] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:34.479410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.499493 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 285/565] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:34.500320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.569319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.595886 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a82c-1865-4678-b3c3-163a0834c4d5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.608614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328dd4d-d543-4552-9ff3-6e20c0e44374 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.632740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.633967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.634261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.634538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.644169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.644926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.645038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:34.645203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.645470 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.646140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:34.646442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.647792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:34.650761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.651859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:34.652702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 281/566] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.653400 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.662594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 286/567] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:34.663577 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.686847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.761975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3197e-0cfe-45ce-b351-23ce84895ec7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.770957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc809cb-e980-40e5-9132-47a2c2fd802f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.796431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.797060 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.797341 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.797613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.804087 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.804886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.806168 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.806515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.806789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.808663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.810172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.813823 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.815269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:34.824634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.825649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:34.826542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:34.826542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:34.826542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:34.826542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 282/568] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.826542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:34.828217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.829097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 287/569] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.831135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.913816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:34.925820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0fdd5-af71-47c6-8b19-7ec9a33d3643 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.933189 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37e60-cf40-498f-ba8b-c6a5abe9f11e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:34.958429 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.959029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.959306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.959576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.960235 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:34.960538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.962580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.967674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:34.968295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:34.968568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:34.968835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:34.970647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 283/570] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:34.971096 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:34.975609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:34.977065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:34.988517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:34.989478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 288/571] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:34.990948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.027559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.074760 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4937-509c-4d72-bc11-bb8aecfbc209 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.089289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558bd2b-2da5-4fbf-9b91-4f1e00ddbe8c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.107705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.108319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.108595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.108867 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.118802 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:35.122737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.123340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.123621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:35.123791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:35.129538 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:35.130647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:35.131276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.131276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.131276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.131453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 284/572] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:35.131453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.131581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.136447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.148764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 289/573] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Aug 12 10:59:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.148764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.230684 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cee92-23cc-460d-a506-6971917e9b19 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.243427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.243688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48aa4-a697-40b8-9ea1-57d8be304b05 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.263562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.264163 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.264442 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.264711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.265351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.265655 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.267058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.277465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.278111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.278393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.278663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.279845 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 285/574] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.280643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.293469 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.294938 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:35.309113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:35.310154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:35.315897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:35.315897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:35.315897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:35.315897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 290/575] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:35.315897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.363444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.386386 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea14053-5c4d-4246-b2ba-77f211aa4506 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.412213 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378816-0410-4788-9adf-ed9cbdc05871 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.421118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.421713 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.422017 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.422291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.422975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.423278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.424715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.440671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 286/576] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.443962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.447043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.447648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.447923 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.448190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.448846 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.449145 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.450566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.458777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 291/577] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.459570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.473255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.540418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8276105-4257-4d50-bc75-66a68088d954 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.556979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848ba7-1bb6-4d56-91a9-9456c8d0012d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.568960 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.574513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.575134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.575411 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.575681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.586127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.587671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.591062 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.591687 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.591971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.592247 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.599699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.601118 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:35.601415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:35.603207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:35.604251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:35.604251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:35.604251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:35.604251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 287/578] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:35.604251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:35.615956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:35.616926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 292/579] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:35.618808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.692368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.707598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f85e-ff42-48be-8049-1307e759c710 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.717354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9128dc-fc54-4a55-bc2d-181dc29aed5f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.741182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.741783 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.742092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.742369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.743530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.743834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.745223 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.751271 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.751874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.752151 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.752421 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.753137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=9c23671f02e94d86b5a9e1e081cfe72f) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.753439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.754882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.756681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 288/580] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.757533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.760377 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 293/581] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/role_assignments?user.id=9c23671f02e94d86b5a9e1e081cfe72f&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.761393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.800281 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.873902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad4670-b23e-47fe-ba1a-f203cdce7c4b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.875044 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ae1c2-b4bf-476a-9280-3fadf4ea2c88 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:35.912734 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.913342 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.913622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.913724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:35.913911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.914375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:35.914568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:35.914692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:35.914989 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:35.915103 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.916736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.925707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:35.927180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:35.933662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 294/582] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:35.933662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:35.933902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:35.942751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:35.950715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:35.951618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:35.951618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:35.951618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:35.951618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 289/583] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:35.951618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.041873 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.048460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90406775-a65c-4d50-8e18-96bf6960a89e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.054173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434b4c0-bbdc-4985-90e6-44d1399a9a48 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.083502 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.084111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.084390 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.084660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.085385 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:36.085686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.087528 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.092333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.092964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.093247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.093524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.102913 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.104362 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.111082 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 295/584] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:36.111082 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:36.120775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:36.121708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:36.122682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 290/585] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 10:59:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:36.123252 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.181027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.220876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1225cfe-59ac-4d07-b3b6-a250139f25c0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.225734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe835-58b5-4d09-b193-86172f8f40a0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.271890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.272525 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.272934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.273214 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.273863 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:36.274344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.274609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.275544 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.275774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.275940 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.276351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.283687 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.285132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.288138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 291/586] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:36.289139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:36.297516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:36.298447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:36.299341 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 296/587] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:36.299813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.319588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.400262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a619f-946e-4d67-ace6-0fe2fdcae657 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.410436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73186427-e668-488f-a66e-2482d689cf8c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.418379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.440187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.441233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.444247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.444247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.454645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.455024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.455340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.455622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.455894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.456625 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:36.456716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.456930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.458366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:36.471689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:36.472626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:36.478548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:36.478548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:36.478548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:36.478548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 292/588] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:36.478548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.482800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 297/589] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:36.486615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.558441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.582682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e5b60-0315-4a5f-8ec3-42c292713cc9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.589343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733a46f-2064-4411-94a0-66d765a5da70 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.619255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.620090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.620518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.620933 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.623569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.624181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.624467 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.624749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.625441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:36.625748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.627212 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.629770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.631225 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.644230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 298/590] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:36.644230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:36.644745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:36.645591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 293/591] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:36.646553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.676433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.751955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023429aa-a16c-40bb-8525-eee5894016d8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.759580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b23d9-de1d-412d-80b8-30bcecfc4e5c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.786835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.787432 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.787717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.787995 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.791865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.796598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.797204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.798028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.818902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.818902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:36.818902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.818902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.819220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.819220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.819359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 299/592] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:36.819359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:36.822603 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:36.823518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:36.824365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:36.824365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:36.824365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:36.825063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 294/593] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:36.825718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:36.914126 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:36.925559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3366ba-eed4-4c1d-ab90-efe474cbf32a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.936051 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653f194-958b-41ef-876b-84b0f9fcf040 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:36.960835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.962094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.962425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.962739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/750b5024846749d88f240449d6fe0dc3/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.972585 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:36.973183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:36.973466 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:36.973740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:36.974506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:36.974820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.976233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.978714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=750b5024846749d88f240449d6fe0dc3, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:36.980182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:36.993077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 295/594] 10.222.0.40 () {56 vars in 1139 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:36.993965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.087999 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 300/595] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:36 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/750b5024846749d88f240449d6fe0dc3/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:37.089448 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.091832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935ee3-52a6-4337-80ee-b4b0bf848221 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.131367 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.132313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.132803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.133253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.141049 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.142835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.145341 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:37.150372 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:37.157496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:37.159575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:37.160476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:37.162275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 296/596] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:37.163394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.237456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151f743-6195-4bec-9528-d2fee72e359a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.285334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.286264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.286546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.286820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.287477 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:37.287591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7704001-5fb8-47b8-80e9-aab7ecbb51b3 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.288005 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.289310 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.307724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 301/597] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:37.308765 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.329119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.330245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.330814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.331295 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.343763 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.345845 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:37.361642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:37.362915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:37.363773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:37.363773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:37.363773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:37.370176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 297/598] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:37.371325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.428885 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:37.430960 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa67e3-342f-4e08-ab5b-1787cb197cda None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.432715 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:37.475127 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.476058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.476344 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.476623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.477769 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:37.478115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.479554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.494534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e9e0-37f5-44da-9a6a-81026f203c77 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.500268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 302/599] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:37.500268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.539365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.540328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.541014 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.541689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.549141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.550849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:37.564365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:37.565270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:37.566156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:37.568522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 298/600] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:37.569570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.634947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77eff0-7a92-498f-9299-16be4c849f46 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.677842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.678410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555185-3fe4-40d5-887d-ea915f645911 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.678537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.678753 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.679028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.679676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:37.679980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.682064 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.691238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:37.695608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 303/601] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:37.696870 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.721569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:37.722682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6935a-50c2-4f06-bc5d-2574cba6449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.723345 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6935a-50c2-4f06-bc5d-2574cba6449e None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.723625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6935a-50c2-4f06-bc5d-2574cba6449e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.723907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6935a-50c2-4f06-bc5d-2574cba6449e None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/5175fc19ac5f492ea6bd5449ee92dd8f/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.739519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6935a-50c2-4f06-bc5d-2574cba6449e None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=5175fc19ac5f492ea6bd5449ee92dd8f, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.741166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6935a-50c2-4f06-bc5d-2574cba6449e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.799601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ca55a-3cdc-4866-9d01-8dc4a4c2b8e4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.824407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 299/602] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:37 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/5175fc19ac5f492ea6bd5449ee92dd8f/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:37.824407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c83f1-63ef-4b2f-b700-2ad695175760 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.824407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c83f1-63ef-4b2f-b700-2ad695175760 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.824407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c83f1-63ef-4b2f-b700-2ad695175760 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.824407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 300/603] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:37.824407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c83f1-63ef-4b2f-b700-2ad695175760 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:37.854092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:37.854719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.855051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.855330 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.856133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:37.856469 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:37.858057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f538e-a43c-4935-af88-f58e0e90f36a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:37.878312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 304/604] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:37.880003 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:37.880299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:37.880579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:37.901089 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:37.902340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:37.966816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c83f1-63ef-4b2f-b700-2ad695175760 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:37.990672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 305/605] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:37.991931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:38.010801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:38.014586 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.015504 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.015979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.016460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.024535 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:38.026327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:38.038472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:38.039434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:38.040398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:38.044020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 301/606] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:38.053345 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:38.094365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:38.121641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359dad-b636-431d-b0d6-273f3ee76ebc None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:38.176872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.177897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.178557 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.180122 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/eb9bed06ddf345e7aa00bde7a8ad770b/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.186941 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f418-fbd4-4de9-9377-b9b0ceba3eed None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:38.217996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=eb9bed06ddf345e7aa00bde7a8ad770b, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:38.217996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:38.237866 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.238764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.239251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.239673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.240518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:38.240986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:38.242602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:38.256440 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 302/607] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:38.262331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:38.302006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 306/608] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:37 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/eb9bed06ddf345e7aa00bde7a8ad770b/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:38.362320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:38.366907 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:38.388493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ee80a-79aa-4dc5-9a3f-182898fe7215 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:38.453312 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.454198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.454576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.455699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/86a3eb0257f242fb806b19b9b9e5f3ec/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.479550 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=86a3eb0257f242fb806b19b9b9e5f3ec, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:38.481029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:38.490599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:38.531558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef9af0-853b-4aba-887d-edaa41f2e6df None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:38.545510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 303/609] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:38 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/86a3eb0257f242fb806b19b9b9e5f3ec/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:38.579818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.580476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.580759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.581042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.601048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:38.606831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:38.607845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:38.608653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 307/610] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:38.613908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:38.770068 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446a6c3-5164-4ca9-8a89-79ee39ad136f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:38.801149 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:38.807367 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.807976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.808258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.811924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.811924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:38.811924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:38.811924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:38.819541 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 304/611] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:38.825351 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:38.933810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6b6a-c5d5-4bcc-b87e-01f1c7bc0b2f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:38.958992 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:38.971606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:38.972237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:38.972514 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:38.972786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:38.984006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:38.985460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:38.999513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:39.000483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:39.002014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:39.002014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:39.002014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:39.002014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 308/612] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:39.006469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:39.150648 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193a85-2f9f-4275-bb19-7717443f381d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:39.198106 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:39.198716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:39.198997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:39.199269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:39.199912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:39.200211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:39.201564 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774bbc-5e41-4e3c-b5da-7f486c757e9d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:39.214990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 305/613] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:39.220460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:39.289362 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e15b-3c3c-4a76-9ad0-359cd4ed12e7 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:39.290391 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e15b-3c3c-4a76-9ad0-359cd4ed12e7 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:39.290909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e15b-3c3c-4a76-9ad0-359cd4ed12e7 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:39.293869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 306/614] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:39.302565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:39.302888 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:39.303186 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:39.324485 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:39.325675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:39.330593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01506eb-2bff-419b-baac-2944c23c3bb6 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:39.376000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:39.377980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:39.378624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:39.378903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:39.379178 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:39.388780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:39.390468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:39.396249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 307/615] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:39.410268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:39.411340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:39.412658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 309/616] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:39.418017 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:39.528467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11a40a-7ab1-4f11-8d60-a5990f85009f None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:39.569496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:39.570144 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:39.570430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:39.570732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:39.571823 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:39.572163 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:39.573570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:39.600055 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 308/617] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Aug 12 10:59:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:39.605198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:39.641148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:39.711851 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51657b47-3199-4a20-9c14-647573953d80 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:39.751438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:39.752074 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:39.752358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:39.752640 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:39.763517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:39.764974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:39.794276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:39.795268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:39.796739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:39.796739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:39.796739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:39.796739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 310/618] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:39.803054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:39.860350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:39.874431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:39.962304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0132db-98e4-45c4-847a-924d4328ebd6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.002230 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.003119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.003421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.009939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.009939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:40.009939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.009939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.018961 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.019319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 309/619] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:40.031071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.036331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec03ce-9625-43b3-9c10-c7b0ddcaed47 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.088221 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.089358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.089835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.090403 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.111751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:40.117125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:40.118672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:40.119503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:40.122088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 311/620] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:40.132803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.158691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.162466 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2e2f-ff00-44e6-b899-d6d5d5ea2e52 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.209713 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.210557 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.210942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.211379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.219937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.221768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:40.249157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:40.250175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:40.251673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 310/621] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:40.256370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.325839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91e76-7bc7-4b55-8d3e-652ed015b2a2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.362277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.368699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.369712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.370010 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.370695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:40.370999 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.372378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.396295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 312/622] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:40.403305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.417644 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.433067 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a917a4-940d-4422-b496-e382d739ea16 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.476355 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.476883 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.477404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.478136 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.478916 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:40.479233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.480668 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3bcb-ee2b-4e46-9328-8a370398edce None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.494770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 311/623] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:40.496071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca863179-f8d4-4bbf-92ff-1a634dbd6627 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.496358 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca863179-f8d4-4bbf-92ff-1a634dbd6627 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.496638 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca863179-f8d4-4bbf-92ff-1a634dbd6627 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.497862 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 312/624] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:40.502739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca863179-f8d4-4bbf-92ff-1a634dbd6627 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.525512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64621-f650-4acb-a0fd-e33f0e44edf3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.550300 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.561848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.562662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.562944 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.563217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.574366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.575876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-7201e98c-1231-491c-aae4-3273ce4426e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:40.590728 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:40.591709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:40.592568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:40.592568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:40.592568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:40.596777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 313/625] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:40.598259 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.598552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.598829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.614172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca863179-f8d4-4bbf-92ff-1a634dbd6627 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.618293 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:40.619494 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:40.652614 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859a26-2083-43d2-acdc-744b27021228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.653278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859a26-2083-43d2-acdc-744b27021228 None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.653561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859a26-2083-43d2-acdc-744b27021228 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.653837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859a26-2083-43d2-acdc-744b27021228 None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/9c23671f02e94d86b5a9e1e081cfe72f/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.670698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859a26-2083-43d2-acdc-744b27021228 None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=9c23671f02e94d86b5a9e1e081cfe72f, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.672270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859a26-2083-43d2-acdc-744b27021228 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.681486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.698767 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 314/626] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:40.698767 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.746027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 313/627] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:40 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/9c23671f02e94d86b5a9e1e081cfe72f/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:40.746027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acecc0-ce1e-4f0d-8c93-b5743be98cd7 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.746027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acecc0-ce1e-4f0d-8c93-b5743be98cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.746027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acecc0-ce1e-4f0d-8c93-b5743be98cd7 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.746027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 314/628] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:40.760172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.760662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.760941 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.800840 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:40.802113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:40.847764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247131f7-3e82-432a-a604-29757fd4fc70 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.894169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.895177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.895679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.896141 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.897035 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:40.897599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.899456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.906340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.916435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 315/629] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:40.929565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 315/630] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:40.937654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.979077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.054355 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f83d28-8398-4b68-83e9-96c51b768345 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.065394 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.108676 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.109319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.109597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.109868 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.123835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:41.125304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:41.135679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c79a78-40ea-4abf-9eee-7fa44fde12c2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1bb68a1a-9fde-44e1-9911-ce4bec5f294d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:41.146654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:41.147636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:41.148559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 316/631] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:41.150169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d735941-de11-4507-a63d-fe43aea34516 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.150169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d735941-de11-4507-a63d-fe43aea34516 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.150464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d735941-de11-4507-a63d-fe43aea34516 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.152016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 317/632] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:41.156963 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d735941-de11-4507-a63d-fe43aea34516 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.175316 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93878e1-8512-4b12-b2c8-48b6b86e8bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.176342 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93878e1-8512-4b12-b2c8-48b6b86e8bef None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.177054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93878e1-8512-4b12-b2c8-48b6b86e8bef None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.177474 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93878e1-8512-4b12-b2c8-48b6b86e8bef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.191501 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93878e1-8512-4b12-b2c8-48b6b86e8bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-c93878e1-8512-4b12-b2c8-48b6b86e8bef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:41.198130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:41.199240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:41.200237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:41.202664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 316/633] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:41.208835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.208835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.208835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.228043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.232051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:41.233471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:41.269645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d735941-de11-4507-a63d-fe43aea34516 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.306714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.307238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.307439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 317/634] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:41.314168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.314168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.314358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.314447 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:41.314447 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:41.314447 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:41.344000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 318/635] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:41.345296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.373263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.452634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4749a3-9157-410c-b9cc-1e7fabd969bc None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.469092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a03c4-b111-46f6-9f6d-bddeb2998fa0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.488703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.489320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.489600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.489980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.490581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:41.490885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:41.492244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:41.502273 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.507249 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 318/636] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:41.509004 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.516113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.521446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.521446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.521446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.531914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:41.538374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:41.539334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:41.540767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 319/637] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:41.543841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.623031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e45ab-85ae-4efe-858f-047cc44c8323 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.625362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.658298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45665bbe-7133-4c6b-84e6-2946fcb39887 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.663368 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.663968 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.664247 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.665211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.695142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.695892 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.696173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.696494 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.706485 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:41.707935 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:41.723140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:41.724086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:41.724954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:41.724954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:41.724954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:41.724954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 320/638] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:41.724954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.746943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:41.748392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:41.760255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.836755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0ff4-2116-42d0-9caa-44cc2768e25e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.850701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 319/639] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:41.851720 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.855937 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.878638 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:41.879272 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:41.879555 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:41.879837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:41.880574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:41.880937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:41.882347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:41.891276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 321/640] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:41.892071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:41.966512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c8849-8c25-4b92-9990-d9ef5469d806 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:41.988390 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.997698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb42ddf-92e5-429d-8cd3-e95d8e6faa75 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.002047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.002670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.002951 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.003222 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.013942 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:42.019313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:42.020294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:42.021116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 320/641] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:42.022356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.038721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.039382 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.039676 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.039953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.040602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:42.040906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.042558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.054889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 322/642] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:42.056224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.092330 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.130994 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f99032-80ae-40b5-bfd6-f119cd72a389 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.156688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9ad8-d266-4b1c-98ee-46c9c1583388 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.165766 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.166670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.166951 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.167221 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.178309 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.179778 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.190959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.191576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.191854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.192122 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:42.193645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:42.194633 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:42.195561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:42.195561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:42.195561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:42.195561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 321/643] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:42.196883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.209125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.210598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:42.225981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:42.227469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:42.228677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:42.228677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:42.228677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:42.228677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 323/644] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:42.228916 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.236775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.310104 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a23a-12c3-4c0b-9eae-5ba4e57e9855 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.323640 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.340218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75890588-dc94-4867-aa9c-139144f57367 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.344168 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.344774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.345050 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.345321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.346015 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:42.346318 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.347755 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.357678 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 322/645] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:42.358522 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.382559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.384225 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.384876 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.385410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.393962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.395635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:42.407864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:42.409016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:59:42.410191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:42.412098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 324/646] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:42.413025 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.467542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe337370-2ca9-4b81-90f0-d625e2bbc1bc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.487708 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.503974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.504592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.504873 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.505147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.506051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:42.506185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.507496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.520310 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 323/647] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:42.521359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.534313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3c437-4b6c-4062-aba8-02a6a40bc30c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.559177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.570275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.570964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.571236 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.571512 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.575414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:42.575414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.575414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.591549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 325/648] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:42.591549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.633786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d387e94-eb9a-422c-a713-c020b5bbf4fc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.670066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.670696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.671001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.671354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.683161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.684594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.699202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607aaf3-43ad-42fb-baa6-cb71e999e681 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:42.699352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:42.700232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:42.706071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:42.706071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:42.706071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:42.706071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 324/649] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:42.706071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.735323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.746387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.747986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.747986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.747986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.748344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:42.748654 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.750109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.768812 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 326/650] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:42.769834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.807570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.822008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f0f9-ac60-4556-ac23-ed94ec1a1ea4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.880995 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f43ce-47bf-493c-82e0-10ddb3439f58 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:42.917147 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.917696 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.917998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.918269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.926175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.927632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:42.940551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:42.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:42.942546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 327/651] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:42.943630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:42.975084 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:42.975697 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:42.975972 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:42.976240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:42.983393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:42.984829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:42.987618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:42.996263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:43.000588 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 325/652] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:43.001777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.048293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85b3b5-4ce5-489c-af99-e513523fe112 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.082566 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.083168 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.083454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.083731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.084377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:43.084683 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.086145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51368803-c907-4f7b-a1f0-9c9a5c5f14bc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.097885 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 328/653] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:43.098744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d1296-01df-4b45-9686-f557e97dbdfc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.099074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63583c-4af5-4963-b060-5872359fe889 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.099361 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63583c-4af5-4963-b060-5872359fe889 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.099636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63583c-4af5-4963-b060-5872359fe889 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.102311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 329/654] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:43.102311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63583c-4af5-4963-b060-5872359fe889 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.137875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.138505 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.138789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.139070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.157019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.205164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63583c-4af5-4963-b060-5872359fe889 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.206623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.207102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.208544 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.240141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.240736 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.241022 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.241298 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.242060 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:43.242965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.244352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.263178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 330/655] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:43.264044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.311994 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 326/656] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:43.312827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.359076 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7209140-cc03-4a59-8869-dbd8102f953b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.362698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.392257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.392860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.393139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.393410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.394142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:43.394485 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.395903 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944c4a2-b2d2-485e-8ecf-60c74d55c189 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.407218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 331/657] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:43.408405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.408695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.408968 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.411698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c02ae-6a4b-4849-9d35-a191fe22f066 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.426536 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:43.427720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:43.449072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.449711 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.450024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.450302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.457316 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.458720 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:43.470226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:43.476651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 327/658] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:43.478194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.495329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 332/659] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:43.496092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.541745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.585771 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae9f7-c885-4c84-87e7-57b347089126 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.597584 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.600091 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7827e8-24f1-4ce1-afe2-e97c1ad5f8c0 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.625616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.626251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.626531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.626800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.636505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.637139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.637421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.638082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.648649 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.650370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:43.665769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:43.667135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:43.668013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:43.668013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:43.668013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:43.670562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 333/660] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:43.672143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.674786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.697874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.699359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.777866 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9b222-ec8e-4748-9987-4217e7681fe0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.807455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 328/661] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:43.808302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.812291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.812888 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.813169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.813444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.814201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=750b5024846749d88f240449d6fe0dc3) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:43.814516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.815942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.820103 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.821694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 334/662] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/role_assignments?user.id=750b5024846749d88f240449d6fe0dc3&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:43.822507 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.906266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:43.922387 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e49033-97a5-4121-893d-e83e55da998c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.947277 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c83ebe-504e-4164-9f57-16d5cf37ee02 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:43.960940 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.962216 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.962498 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.962772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.963592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:43.963800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:43.966169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:43.985682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 329/663] 10.222.0.40 () {56 vars in 1139 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:43.986390 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:43.997631 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:43.997631 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:43.997945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:43.998244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:43.998972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:43.999285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.000651 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.014902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 335/664] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:44.015742 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.072302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.111122 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d870fe-57fc-4984-8097-6818ba142aa4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.121630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3831-88f5-4f04-a8cd-612ad4153043 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.146565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.147342 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.148042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.148432 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.149112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.156884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.157591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.157987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.158330 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.160296 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:44.165575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:44.167612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 330/665] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:44.170725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.174902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.176663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:44.192865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:44.194038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:44.194904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:44.194904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:44.194904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:44.194904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 336/666] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:44.194904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.284711 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f11e-e8f4-428d-bf92-ad3869a8b0a3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.303715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb2d2-c426-4f04-8378-523289e5e022 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.311085 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.319909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.324362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.324362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.324362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.341075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.341844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.342255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.342532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.351454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.353651 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:44.365270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:44.366286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 337/667] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:44.372446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.396903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.398380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.416731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.483787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983294d-4a62-4644-8d6b-2e4968efba15 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.511725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 331/668] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:44.512411 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.523012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.523793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.524179 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.524529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.525266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:44.525623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.527088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.540128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 338/669] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:44.540128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.544696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.621691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdc2da-c262-441d-afda-6467498ff512 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.640469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.643505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c04f5-3189-4e7d-8494-6ac92dec2e67 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.657176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.657785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.658090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.658359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.658990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:44.659288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.660643 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.672700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 332/670] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:44.677412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.682539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.683229 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.683592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.683945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.684724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:44.685109 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.686660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.704206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 339/671] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:44.704206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.774033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.788361 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf3b0-dae4-4bf0-a1c1-a81b034e399b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.808011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be885a70-a86d-4340-b4cb-3009b81d5e3d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.826421 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.827174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.827562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.827937 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.839259 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.840706 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.843451 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:44.844077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:44.844485 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:44.844812 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:44.855049 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:44.856481 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:44.857399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:44.858338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:44.859278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:44.859278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:44.859278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:44.860289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 333/672] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:44.860901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:44.879487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:44.880465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:44.881340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:44.881340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:44.881340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:44.881340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 340/673] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:44.881340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:44.899964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.975993 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f3cc5-3516-4a55-9790-0fff4a6e708d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:44.998271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76f262-ea51-47f3-955c-367da0b75057 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.015454 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.016090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.016371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.016640 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.024240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.025681 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.027555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.032988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.033582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.033859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.034162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.034883 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=5175fc19ac5f492ea6bd5449ee92dd8f) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.035185 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.036612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:45.038831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:45.046825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 334/674] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:45.047936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.050951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 341/675] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:44 2022] GET /identity/v3/role_assignments?user.id=5175fc19ac5f492ea6bd5449ee92dd8f&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.058167 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.163844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5bac-3272-4158-9ccf-d0b1a0d8b366 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.174156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.204979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.205785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.206192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.206569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.207230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.207538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.208825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980484-4e83-43ab-8f41-5ffef10324a7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.208998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.224575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 335/676] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.225739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.266548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.267434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.267713 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.267980 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.268625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.268978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.270469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.284326 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 342/677] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.285157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.298536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.349554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123cdbe-8292-4ca0-97f1-3c588baced05 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.387116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.387878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.388318 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.388754 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.389484 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.389900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.391455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.409189 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 336/678] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.409754 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980d9b6-6307-4d09-b5d2-55af05921c6a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.410374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.448068 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.448939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.449370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.449791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.452934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.458408 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.460071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:45.472955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:45.474101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:45.475211 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:45.481846 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 343/679] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:45.482921 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.525331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df8e86-2285-4718-b620-267913b97cf5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.543891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.563165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.564056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.564472 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.564891 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.573955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.575558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:45.590157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:45.591308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:45.592457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:45.595228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 337/680] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:45.595228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.605650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956b84-aa47-4ca1-975c-29df7855022f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.642816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.643661 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.644080 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.644505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.645404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=eb9bed06ddf345e7aa00bde7a8ad770b) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.645875 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.647472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.655133 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 344/681] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/role_assignments?user.id=eb9bed06ddf345e7aa00bde7a8ad770b&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.656255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.723002 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.738689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43d1e-c819-41f6-9c3a-de1bb316661a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.768932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc757db-f28f-4a5f-87a8-c265da989f1e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.777344 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.778142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.778983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.778983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.779712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.780118 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.781714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.795515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 338/682] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.812637 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.817093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.818091 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.818534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.818979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.819901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:45.820359 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:45.822719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c621a-16ab-4ab0-81ee-369af7ecbf9b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:45.847908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 345/683] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:45.849630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ef326-5649-4ba6-ac6f-4a90cce20ccd None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:45.850126 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ef326-5649-4ba6-ac6f-4a90cce20ccd None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:45.850545 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ef326-5649-4ba6-ac6f-4a90cce20ccd None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:45.852604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 346/684] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:45.854489 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ef326-5649-4ba6-ac6f-4a90cce20ccd None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:45.885366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.956801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624da0-1fc6-4233-9053-a8afa753bdd3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.979627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ef326-5649-4ba6-ac6f-4a90cce20ccd None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:45.999159 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:45.999767 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.000043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.000313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.001046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=86a3eb0257f242fb806b19b9b9e5f3ec) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:46.002858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:46.009229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.010764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b98dd6-90a4-44fb-adf1-2b0591e01b5b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.021208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 339/685] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/role_assignments?user.id=86a3eb0257f242fb806b19b9b9e5f3ec&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:46.022261 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.022544 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.022815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.025314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:46.026180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.026662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.027127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.044056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:46.045117 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:46.128074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.129879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.141781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 340/686] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:46.247479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 347/687] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:46.253049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.295343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:46.379945 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11623f-314f-464c-9558-fc60bf4d31fb None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:46.420236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:46.421241 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.421729 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.422226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.433760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.435594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.452103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:46.452288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:46.453175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:46.454101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:46.454101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:46.454101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:46.457878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 341/688] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:46.459110 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.480417 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:46.580015 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647251ee-4400-42ba-a424-11db76aa0989 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:46.621774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:46.623459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:46.624617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.625112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.625596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.637756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.639595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.649334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfc7da-0a19-415e-9a66-3182634d4892 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:46.655759 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:46.656717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:46.657589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:46.657589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:46.657589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:46.659665 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 348/689] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:46.666967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.725552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:46.728518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.729301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.730396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.731859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:46.732573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.735072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.762313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 342/690] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:46.763236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.778625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:46.813299 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f00a91-6ea2-4b2b-b209-ca1ef762f950 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:46.886577 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091526a-009d-4b18-b4bf-192639f70f94 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:46.890551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:46.891476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.891975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.892447 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.893311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:46.893894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.895661 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.924409 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 349/691] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:46.930598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.932538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:46.933173 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:46.933452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:46.933720 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:46.950609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:46.952060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:46.971170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:46.972092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:46.973045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 343/692] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:46.979312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:46.986714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:47.129385 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c191beb-8e98-4f26-8f57-2f75cbfdb39f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:47.161643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:47.169453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784595-766c-4a62-8440-8119be3b5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:47.176772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784595-766c-4a62-8440-8119be3b5137 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.176772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784595-766c-4a62-8440-8119be3b5137 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.176772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784595-766c-4a62-8440-8119be3b5137 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.176772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6784595-766c-4a62-8440-8119be3b5137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:47.176772 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6784595-766c-4a62-8440-8119be3b5137 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:47.187854 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbd0b-ace0-4386-9d0d-39ab76833537 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:47.227806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:47.228397 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.228670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.228936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.229629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:47.230031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:47.231456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7090fe-9404-4b26-a56e-1d6c3cc303de None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:47.244782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 344/693] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:47.246090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9b78-5fa6-47fe-af08-b7802dfb9b00 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.246371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9b78-5fa6-47fe-af08-b7802dfb9b00 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.246638 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9b78-5fa6-47fe-af08-b7802dfb9b00 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.248055 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 345/694] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:47.250606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9b78-5fa6-47fe-af08-b7802dfb9b00 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:47.266197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 350/695] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 10:59:46 2022] POST /identity/v3/users => generated 254 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:47.267633 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.269495 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.269495 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.312492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:47.315158 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:47.384894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:47.448164 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9b78-5fa6-47fe-af08-b7802dfb9b00 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:47.461950 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 351/696] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:47.488776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:47.489383 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.489657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.489948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.490669 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=9c23671f02e94d86b5a9e1e081cfe72f) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:47.490974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:47.492511 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:47.499273 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 346/697] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:47 2022] GET /identity/v3/role_assignments?user.id=9c23671f02e94d86b5a9e1e081cfe72f&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:47.736977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:47.844560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda32e3-40de-4e8f-8b42-fa93e3a339d6 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:47.863807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:47.885093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:47.885746 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.886057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.886333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.886929 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:47.888296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:47.904767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:47.905814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:47.906718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 352/698] 10.222.0.40 () {56 vars in 1129 bytes} [Fri Aug 12 10:59:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:47.912061 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:48.020555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad56d74-69a5-432e-b68b-bec497783a4b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:48.048063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:48.057149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:48.061866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.061866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.061866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.061866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:48.061866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:48.061866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195145a-07d8-44f1-bb90-52c43c226f02 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:48.065706 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 347/699] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Aug 12 10:59:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:48.071463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:48.101305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e693b-2d3e-4237-99f7-185b43008a0a None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.102187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e693b-2d3e-4237-99f7-185b43008a0a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.102460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e693b-2d3e-4237-99f7-185b43008a0a None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.105017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 348/700] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:48.109406 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.109693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.110006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.130669 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:48.131978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:48.185638 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d6e-18c5-4e30-b0ef-8ad4a370deb8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:48.206756 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 349/701] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:48.219946 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:48.220558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.220840 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.221113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.221756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:48.222095 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:48.223547 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:48.230414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 353/702] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Aug 12 10:59:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:48.499883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:48.620731 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31dd53-f7e8-44ed-b1b8-a9dcfb39c139 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:48.655583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:48.669637 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cfa87-d9fa-4c91-8e60-67be79211769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:48.670300 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfa87-d9fa-4c91-8e60-67be79211769 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.670584 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfa87-d9fa-4c91-8e60-67be79211769 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.670855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfa87-d9fa-4c91-8e60-67be79211769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.685080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cfa87-d9fa-4c91-8e60-67be79211769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-c35cfa87-d9fa-4c91-8e60-67be79211769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:48.690033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:48.690928 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:48.691747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:48.692809 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 350/703] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:48.698266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:48.764464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:48.782432 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a681a7-4b7a-4be4-aa96-5781cbdcfd31 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.782722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a681a7-4b7a-4be4-aa96-5781cbdcfd31 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.783001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a681a7-4b7a-4be4-aa96-5781cbdcfd31 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.784346 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 351/704] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:48.790033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.791290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.791290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.826979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:48.828188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:48.833165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed3162-b511-40c1-b817-c2d82821ac68 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:48.868166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:48.868768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:48.869042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:48.869314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:48.870004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:48.870308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:48.871662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:48.880540 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 354/705] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:48.889127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:48.959776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 352/706] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:49.019177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa51cc5-a3e8-48b6-9cb9-d4e2d7ebdd6b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.053572 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.054230 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.054507 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.054807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.055596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:49.066090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:49.067524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:49.081936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:49.082871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:49.083990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:49.083990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:49.083990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:49.083990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 355/707] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:49.095012 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.233775 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d319-4144-463e-94bf-f1bca7aca521 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.296063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:49.327121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.327725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.328056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.328328 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.328961 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:49.329259 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:49.330678 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:49.343108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.344570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 353/708] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:49.349889 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.476180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5bbf-bf8e-4297-9d46-d0eadbd4fc4f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.486907 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4adf9-0a17-4f05-ab28-14243ceb2bee None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.521395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.521626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.522243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.522523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.522797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.523209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.524348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.524874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] PATH_INFO: `/v3/services/network` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.525688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:49.531340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:49.531815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:49.533255 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:49.542656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:49.543646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:59:49.544465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:49.547270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 356/709] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:49.555370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:49.558041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:49.559223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:49.560185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:49.561950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 354/710] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:49.563823 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.600892 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:49.607890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:49.673676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed84d9-6294-4956-9df3-22caca6d5141 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.712184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.713101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.713512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.714019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.714999 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:49.715434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:49.716985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:49.736622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 355/711] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:49.742518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.765012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8abe-85d2-49dd-a6f3-6bd76717a447 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.833404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.834297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.834428 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.834804 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.835512 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] RBAC: Adding query filter params (name=network) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:49.836000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:49.837779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:49.853491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 357/712] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:49.855417 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:49.880415 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:49.907543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f3e8-2b56-424f-a934-79f2cb5be415 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:49.978761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:49.979388 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:49.979642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:49.979909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:49.984895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.000779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32017-9ba9-409d-94eb-6d7eeba27b8b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.037016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.037635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.037943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.038221 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.038854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:50.039268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.040631 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d04d3-b596-4f71-99dc-a90c1d5b70c9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.046034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 358/713] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:50.088765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806039b-19c4-405a-bb10-37bb0805220d None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.089122 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806039b-19c4-405a-bb10-37bb0805220d None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.089317 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806039b-19c4-405a-bb10-37bb0805220d None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.090932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 359/714] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:59:50.096435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd86103-83bb-4b2f-bdff-ab632bcbd3f0 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.096723 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd86103-83bb-4b2f-bdff-ab632bcbd3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.096986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd86103-83bb-4b2f-bdff-ab632bcbd3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.123292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-cdd86103-83bb-4b2f-bdff-ab632bcbd3f0 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:50.124435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.124569 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-cdd86103-83bb-4b2f-bdff-ab632bcbd3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:50.125945 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.218786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 360/715] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:50.218786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0662c-1a8b-4e9c-b4eb-2897456979f9 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.218786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0662c-1a8b-4e9c-b4eb-2897456979f9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.218786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0662c-1a8b-4e9c-b4eb-2897456979f9 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.218786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 361/716] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:50.224244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.224529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.224803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.249607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.261356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 356/717] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:50.266583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.392667 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aa6c-8405-4daf-9fd7-a86cad49b819 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.438262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.439252 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.439743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.440208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.458558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.460362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.461951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:50.463334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:50.477317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:50.478510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:50.479375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:50.479375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:50.479375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:50.481423 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 357/718] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:50.487123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.564808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.589294 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 362/719] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:59:50.631090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.648243 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.668238 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417138-9396-443b-82f5-e518d4d613d7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.727072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.727682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.727959 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.728230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.728876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:50.729174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.730570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.752343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 358/720] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:50.757835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.803296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c9e5f-ee0d-454a-b8e0-135ac3ac0bcf None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.853350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993dc3a-b739-4f19-9755-bab4162e645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.854235 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993dc3a-b739-4f19-9755-bab4162e645d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.854665 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993dc3a-b739-4f19-9755-bab4162e645d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.855087 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993dc3a-b739-4f19-9755-bab4162e645d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.865529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993dc3a-b739-4f19-9755-bab4162e645d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1993dc3a-b739-4f19-9755-bab4162e645d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:50.871192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:50.872148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:50.873004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:50.879801 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 363/721] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:50.881745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6c313-5f25-4e7f-bff5-9d6c23f3e1d7 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.882270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6c313-5f25-4e7f-bff5-9d6c23f3e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.882798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6c313-5f25-4e7f-bff5-9d6c23f3e1d7 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.889104 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 364/722] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:50.890123 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6c313-5f25-4e7f-bff5-9d6c23f3e1d7 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.895651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d74424-6adf-49fa-9dce-907a2497dc0c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.897163 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.939915 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.940547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.940834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.941106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.948185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.949619 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-c8631267-83f4-48e6-8039-2ebac533598e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:50.962208 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:50.963245 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:50.964143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 359/723] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:50.964613 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.964748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.965032 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.969992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.983468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:50.984721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:51.003407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6c313-5f25-4e7f-bff5-9d6c23f3e1d7 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.038958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.040197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.040478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.040748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.041657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:51.041979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.043350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.051712 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 365/724] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:51.052479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.060158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 360/725] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:51.061830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.167360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.176178 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858f1f-0b8a-4605-897a-dce72fe507e5 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.180367 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccbcb1-3d72-4a24-8ecb-b1ff5caf3383 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.212029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.212774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.213118 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.213455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.214251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:51.214618 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.216180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.216573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.223281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.224642 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.224929 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.225201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.236634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 361/726] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:51.241956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.243460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:51.248601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:51.250375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:51.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 366/727] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:51.253605 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.364139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25ced-6e36-4a7a-92ff-da50358513b0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.364472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223690b0-b701-466e-ba20-c09419ebc1ef None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.397626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.397954 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.398291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.398573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.398671 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.398847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.398941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.399115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.399687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=eb9bed06ddf345e7aa00bde7a8ad770b) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:51.399998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.401419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.407012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 367/728] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/role_assignments?user.id=eb9bed06ddf345e7aa00bde7a8ad770b&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:51.407793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.420352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.422180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:51.443419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:51.444413 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:51.445877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:51.445877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:51.445877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:51.452506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 362/729] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:51.452506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.457267 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.496761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.549579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8930f-2ff4-4241-a06a-40f032cf1693 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.592515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.593130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.593413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.593687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.594799 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:51.595335 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.597508 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.600258 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dbe0f-40f3-4ab0-9ddd-844ba968e47f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.607348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 368/730] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:51.608202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.644865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.645852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.646353 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.646823 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.647681 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.650769 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.714931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42770eb4-6a8d-45f2-b415-e175d6995741 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.732350 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.747866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 363/731] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 10:59:51 2022] POST /identity/v3/services => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:51.750235 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.766700 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.767403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.767600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.767912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.768566 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:51.768939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.771018 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.784738 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 369/732] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:51.791970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.841072 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.893881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a09a7-6d65-4ef4-9623-b2d5fc276276 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.938140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.939812 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.940317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.940786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.955454 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.957267 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:51.976200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:51.977858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:51.978757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:51.978757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:51.978757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:51.981158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 364/733] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:51.986518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.022934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a7a8-e118-46cf-82ab-011bbacea852 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.062655 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.063017 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.063348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.063633 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.072353 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.073805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:52.087928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:52.088911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:52.089839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 370/734] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:52.094990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.120305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c079-6180-47de-88e9-409c51be7782 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.135327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:52.141321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:52.160875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.161485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.161764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.162077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.173287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:52.173287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.173287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcfaa3-aa0e-40e8-91b6-a13e9311f585 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:52.180816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 365/735] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:52.182540 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db3c14-6ffb-459e-a78d-47274fcf50ac None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.183095 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db3c14-6ffb-459e-a78d-47274fcf50ac None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.184105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db3c14-6ffb-459e-a78d-47274fcf50ac None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.190349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 366/736] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:52.191699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db3c14-6ffb-459e-a78d-47274fcf50ac None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.215169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1190d-2e24-4718-8d7d-024896e38d05 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.257762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.258746 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.259255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.259730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.260671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:52.261199 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.262943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0952-2295-46e7-9721-0dcb14812873 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:52.284610 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 371/737] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Aug 12 10:59:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:52.286247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.286756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.287242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.306727 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:52.308258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:52.329659 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db3c14-6ffb-459e-a78d-47274fcf50ac None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.380485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.381129 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.381406 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.381685 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.390299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.391911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:52.394011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 372/738] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:52.395293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:52.418842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:52.420029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:59:52.421063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:52.424471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 367/739] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 10:59:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:52.430638 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.457843 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:52.498571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:52.573183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9a6a3-652f-4e7c-a4f4-abbf44f114eb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.612913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.613797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.614258 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.614826 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.615696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:52.616148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.618019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:52.637580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 368/740] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Aug 12 10:59:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:52.647113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.668705 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027871b-98f2-420f-90e5-8423c429a848 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.708424 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.710428 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.711413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.711829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.790292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:52.799895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.800136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53725-f6d0-4c65-96e7-057d73e62ff4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:52.805460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:52.829879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:52.842772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:52.843388 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:52.843670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:52.843943 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:52.908662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 373/741] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:52.909936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:52.944004 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:52.947559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.020667 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2075e-898e-4e36-b19d-e38037da150a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.055143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.066428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.081564 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.081738 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 369/742] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 10:59:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:53.081738 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.083012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.083458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.083986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.084842 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.086967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.160039 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 374/743] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 10:59:52 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:59:53.162087 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.210495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d83255-ac2b-49e6-9c93-84dafc34a835 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.264492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.265576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.266122 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.266598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.280398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.282350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:53.301853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:53.302864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:53.303776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:53.303776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:53.303776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:53.307105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 370/744] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:53.314349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.394797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.398982 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ecd63-c055-418c-b330-a1fee03e5e4c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.452250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.453035 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.453420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.453980 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.467942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.469488 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.470320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5c80-db9b-4bb4-b889-5fbd6c6e1c67 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-22397b3d-98ae-461b-aaf1-1f8e5a65610d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:53.485348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:53.486561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:53.487554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:53.487554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:53.487554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:53.487554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 375/745] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:53.487883 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599a671-a0e1-4d6a-8e6a-bce5792a16db None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.487883 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599a671-a0e1-4d6a-8e6a-bce5792a16db None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.488156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599a671-a0e1-4d6a-8e6a-bce5792a16db None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.489542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 376/746] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:53.492136 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599a671-a0e1-4d6a-8e6a-bce5792a16db None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.517196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.518159 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.518625 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.519099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.520338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:53.521071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.523360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1647-2498-45de-b7b5-256379c9b540 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.541335 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 371/747] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:53.543130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.543604 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.544595 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.558397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.566045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:53.567593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:53.612265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599a671-a0e1-4d6a-8e6a-bce5792a16db None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.641078 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 372/748] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:53.642360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.658175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.658748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.659164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.659532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.660189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:53.660490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.661889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.678418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.683424 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 377/749] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:53.690055 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.756370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6b8fc-2375-4ed8-a177-b0eaf190e8e5 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.797232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.798277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.798777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.799255 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.807228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.808941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:53.820700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:53.821634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:53.822569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:53.825006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 373/750] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:53.834019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.867729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.879363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d75c3-c768-4ee4-be51-022e45265281 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:53.941881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:53.942492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:53.942778 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:53.943048 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:53.950686 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:53.952190 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:53.964046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:53.964992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:53.966206 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 378/751] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:53.970880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:53.983320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:53.992735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925bfd5-99f9-4e40-950c-d4dff80365ff None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.030211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.030877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.031152 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.031420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.032163 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:54.032465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:54.033983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:54.048277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 374/752] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:54.057357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:54.126522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25bf1b-ca3b-44eb-9237-b5458f0597cf None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.165329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.165953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.166626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.166899 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.167598 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:54.167906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:54.169442 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:54.175151 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7efeec-28de-472a-916d-d70526847498 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.184955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 379/753] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:54.185852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:54.215859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:54.220748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.220748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.221019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.221268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.222009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=9c23671f02e94d86b5a9e1e081cfe72f) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:54.222314 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:54.223726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098885d4-9253-4d5c-9729-d1aba1d26b8f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:54.238067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 375/754] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/role_assignments?user.id=9c23671f02e94d86b5a9e1e081cfe72f&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:54.238067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1353-4455-4d30-bfca-f3b6c0b16e88 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.238067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1353-4455-4d30-bfca-f3b6c0b16e88 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.238067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1353-4455-4d30-bfca-f3b6c0b16e88 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.238067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 376/755] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:54.238067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1353-4455-4d30-bfca-f3b6c0b16e88 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:54.259452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:54.338625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74a54-3c61-4134-b205-8bd82564caab None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.360569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1353-4455-4d30-bfca-f3b6c0b16e88 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.383493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb1fd-f3ea-4a30-8855-3494d09622ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.383493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb1fd-f3ea-4a30-8855-3494d09622ea None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.383802 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb1fd-f3ea-4a30-8855-3494d09622ea None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.383870 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb1fd-f3ea-4a30-8855-3494d09622ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.397189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eb1fd-f3ea-4a30-8855-3494d09622ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-074eb1fd-f3ea-4a30-8855-3494d09622ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:54.404958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:54.405895 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:54.406837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 380/756] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:54.407502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.408056 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.408056 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.414583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.415457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.415932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.416648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.417606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2d9c65025dcd4c5ab7b61a9daeb0945c) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:54.418215 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:54.419846 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:54.426313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 377/757] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/role_assignments?user.id=2d9c65025dcd4c5ab7b61a9daeb0945c&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:54.427379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:54.440215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:54.450843 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:54.538373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:54.564762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513080b-7e95-4ac5-b1f8-0b6049271986 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.614741 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 381/758] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:54.626456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.627082 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.627392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.627631 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.628301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:54.628603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:54.629991 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:54.646295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 378/759] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:54.651932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:54.667964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:54.758012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52143-f8ac-4606-af2d-3cbf02cb5e84 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:54.809548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:54.810122 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:54.810401 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:54.810675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:54.829589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:54.831072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:54.852978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:54.853974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:54.854858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:54.854858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:54.854858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:54.854858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 382/760] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:54.863015 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:54.941580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.034080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a24a0-0772-4405-9554-e82ba5a1fc41 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.070863 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.076365 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.076975 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.077251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.077521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.078200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:55.078497 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.079855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.110076 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 379/761] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:55.115911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.120576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.156158 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d0e85-b5c4-4be4-a6e1-3d364140628b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.220589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4678b2-dfb9-4f59-afa1-604dfbf57d01 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.233615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.234339 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.234617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.234885 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.235478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.236855 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:55.251755 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:55.252771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:55.253588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:55.255108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 383/762] 10.222.0.40 () {56 vars in 1129 bytes} [Fri Aug 12 10:59:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:55.259173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.278820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.279485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.279764 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.280058 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.295844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.297290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:55.320598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:55.321628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:55.322600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 380/763] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:55.329746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.408024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.409758 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953af1-627c-4818-b5bf-ddc55c927711 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.444657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.449865 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.450684 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.451041 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.451414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.452243 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:55.457909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.458050 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c89ac-12d7-4e04-a0a3-576d2793c017 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.458132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926595aa-60d2-4de7-8763-d678581db058 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.462019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 384/764] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:55.463573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6636a-1b4e-4a0d-9045-384f4b619c0c None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.464045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6636a-1b4e-4a0d-9045-384f4b619c0c None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.464482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6636a-1b4e-4a0d-9045-384f4b619c0c None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.469342 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 385/765] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:55.471160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6636a-1b4e-4a0d-9045-384f4b619c0c None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.496940 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.497955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.498414 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.498862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.499791 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:55.500299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.501957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68106a1d-c22e-4477-b0d5-3d84b24b61ba None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.521090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 381/766] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:55.523895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.524392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.524864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.553853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:55.556105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:55.598491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6636a-1b4e-4a0d-9045-384f4b619c0c None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.634344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.635297 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.635810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.636292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.637118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:55.637621 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.639351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.639572 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 382/767] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:55.640484 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.645157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 386/768] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:55.658744 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.715172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.740589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.765209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0176b-3314-4298-a48e-a00bd4cccde8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.802913 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.803680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.804067 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.804546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.805858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] RBAC: Adding query filter params (interface=public, service_id=e15ca56edbc44537a3714be56caf1cba, region_id=RegionOne) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:55.806303 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.807801 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.816001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 387/769] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/endpoints?service_id=e15ca56edbc44537a3714be56caf1cba&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:55.826522 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:55.885276 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470a18f-2695-4090-85a7-a55a3bf464a7 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.942644 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:55.943721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:55.943998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:55.944350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:55.958652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:55.960598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:55.968548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20840cf6-edb8-40de-8c4e-70475a1d2eff None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:55.979302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:55.980304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:55.981180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:55.981180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:55.981180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:55.982024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:55.982138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 383/770] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:55.983031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.006748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.007593 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.007944 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.008285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.008974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.010449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.015828 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 388/771] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:56.016765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.168814 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2c10-a95e-40fb-8483-2c550e849779 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.175930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:56.192573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779bc34-c372-4b19-b3ae-9e9858cdf3cf None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.242406 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.242839 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.243118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.243391 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.244044 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:56.244533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.246699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.249219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.250510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.250993 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.251455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] PATH_INFO: `/v3/services/network` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.252227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.253770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.259376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 389/772] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:56.266944 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:56.267590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:56.271153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:56.272165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 384/773] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:55 2022] GET /identity/v3/services/network => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:56.280273 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.314166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:56.400970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f619a6-a63a-4dd3-afa9-b58c602f8fc9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.406623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0a6ee-a8f9-4d12-a0c0-3eb5654dd732 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.444264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.444264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.444264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.444264 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.444615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] RBAC: Adding query filter params (name=network) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:56.444615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.448456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.456535 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 385/774] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:56.457186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.460230 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.461125 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.461477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.461697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.486585 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.490634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.505803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:56.525347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:56.526332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:56.527203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 390/775] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:56.533370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.616473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b258d6-2b4e-4ecb-95ce-191ab4a34245 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.665420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:56.672140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd6df0-16cf-477c-a9b2-e109782c9bcf None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.672299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.672903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.673182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.673450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.674998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:56.675314 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.676719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacf8d7-7f0e-4780-bf13-b7b42c8a27b7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.686221 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 386/776] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:56.688368 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b81d3-7e96-413a-85fb-961cb319effe None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.688856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b81d3-7e96-413a-85fb-961cb319effe None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.690378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b81d3-7e96-413a-85fb-961cb319effe None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.692811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 387/777] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:56.694130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b81d3-7e96-413a-85fb-961cb319effe None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.718071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.718809 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.719164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.719513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.720293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:56.720662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.722259 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d834-70de-41d6-999b-0af1c7ece0f8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.736384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 391/778] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:56.738152 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.738514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.738866 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.758969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:56.760370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:56.839253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 392/779] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:56.840680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.866322 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:56.869551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b81d3-7e96-413a-85fb-961cb319effe None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:56.919526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:56.920139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.920415 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.920676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.921374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] RBAC: Adding query filter params (interface=public, service_id=d9d40310363b4f16be07b3c3a69f47ca, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:56.921676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:56.923090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5092b7f-9ba6-4a0d-8e64-bc031b19a5d8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:56.931646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 388/780] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/endpoints?service_id=d9d40310363b4f16be07b3c3a69f47ca&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:56.933018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be220-9168-4fbe-973d-3141eb92e67e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:56.933202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be220-9168-4fbe-973d-3141eb92e67e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:56.933465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be220-9168-4fbe-973d-3141eb92e67e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:56.937957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 389/781] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:56.937957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be220-9168-4fbe-973d-3141eb92e67e None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:56.957810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:56.974577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824d6b-34ea-4550-a0ff-b19b929c2899 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:57.029040 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6de892-32b2-49c5-ada6-c8edb0f1f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:57.030188 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6de892-32b2-49c5-ada6-c8edb0f1f6cc None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.030971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6de892-32b2-49c5-ada6-c8edb0f1f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.031351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6de892-32b2-49c5-ada6-c8edb0f1f6cc None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/eb9bed06ddf345e7aa00bde7a8ad770b/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.033719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6de892-32b2-49c5-ada6-c8edb0f1f6cc None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=eb9bed06ddf345e7aa00bde7a8ad770b, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:57.035549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6de892-32b2-49c5-ada6-c8edb0f1f6cc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:57.078006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be220-9168-4fbe-973d-3141eb92e67e None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:57.099115 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 393/782] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:56 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/eb9bed06ddf345e7aa00bde7a8ad770b/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:57.101762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.102390 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.103469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.124930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:57.125564 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.125845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.126150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.126999 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:57.128483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:57.129564 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:57.132088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:57.136331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 390/783] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 10:59:56 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:57.144046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:57.186800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:57.255475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 394/784] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:57.307828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a71fa-eaae-4427-848a-086eb1433b62 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:57.347783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:57.348434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.348714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.348982 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.361585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:57.366503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:57.368456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:57.369279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 391/785] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:57.374765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:57.473635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:57.499747 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1c7f9-7322-4d47-b3f6-6a4acddadb34 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:57.557882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:57.558942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.559454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.559976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.561232 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:57.561808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:57.563426 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:57.578029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 395/786] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 10:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:57.579617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:57.602488 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:57.737207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8913cea-622a-4252-8d0a-c24b86d35498 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:57.769602 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:57.804712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5959dfa-cace-44c0-bb0e-fcdc22242de9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:57.814658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:57.815251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.815526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.815795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.829908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:57.836997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:59:57.841717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:57.847153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:57.848000 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 396/787] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 10:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:59:57.856224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:57.879593 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:57.880277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:57.880559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:57.880825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:57.895939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:57.897406 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:57.913404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:57.915009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:57.915878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:57.915878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:57.915878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:57.915878 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 392/788] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:57.921037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.045306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e21f6-31e0-4d28-828b-23b68b2b81cc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.068192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b116773-b1ea-426d-a79c-34691da6723b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.084521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.085128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.085503 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.085730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.086404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:58.086771 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.088627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.090490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:58.103067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 393/789] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:58.112048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.148852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.149571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.149859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.150159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.150894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:58.151205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.152566 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.170142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 397/790] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 10:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:58.179727 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.258914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:58.297879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852eae-783d-40c2-a2df-64763b89c7ed None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.335349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.337132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.337698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.338183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.350222 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.352557 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:58.369119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:58.370099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:58.370978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:58.370978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:58.370978 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:58.372965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 398/791] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:58.378120 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.384204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c70084-87f3-4f2c-8388-3a90af025b5b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.420186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.420816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.421092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.421363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.428692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.431065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-bca0f096-2b9b-4a86-9487-1c6fe0cd84ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:58.453902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:58.454929 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:58.455839 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 394/792] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:58.456676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9803-ecc2-4cc8-91ca-20cad7e898e7 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.457053 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9803-ecc2-4cc8-91ca-20cad7e898e7 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.457156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9803-ecc2-4cc8-91ca-20cad7e898e7 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.458860 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 395/793] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:58.461965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9803-ecc2-4cc8-91ca-20cad7e898e7 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.503038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05ac06-4b96-4d1b-bf47-facb7106ca5a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.517453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:58.532998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:58.541501 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.542404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.542913 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.543406 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.544250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:58.544749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.546366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de19ca-fa24-4e1a-ad9b-50cc93624d42 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.560418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 399/794] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:58.562141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.562664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.563130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.582397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:58.583904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:58.587359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9803-ecc2-4cc8-91ca-20cad7e898e7 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.624716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.625343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.625623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.625894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.626653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:58.626958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.628459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.647558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 396/795] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:58.648706 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.670284 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 400/796] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:58.671955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.795607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb7c6-da97-4aa4-b3a8-4492aca7ba0d None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.802369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:58.850815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2e3f-13e2-45f7-90bb-d0e4b19fff8b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:58.866851 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.867879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.868359 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.869996 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.880899 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:58.892504 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.897295 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:58.911114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:58.912050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:58.912959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:58.912959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:58.912959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 10:59:58.916743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 401/797] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:58.922148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:58.943048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:58.947075 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:58.947570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:58.948037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:58.965133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:58.967176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:59:58.995955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:58.996950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:58.997887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 397/798] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:58.998490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.080901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c9167-be28-4f91-9b8e-696a001eb2b4 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.113531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c0f7-f744-4ee0-89e9-040a0d057edd None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.125644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.126775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.127260 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.127706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.128749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:59.129665 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.131766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.149136 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 402/799] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:59:59.150473 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.151543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.152253 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.152650 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.152971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.153754 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.155909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:59.165621 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:59.166902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:59:59.167721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:59.172353 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 398/800] 10.222.0.40 () {56 vars in 1129 bytes} [Fri Aug 12 10:59:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:59.172942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.174706 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.216230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.281910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5454-7e66-4c59-90c8-edf9a9ef9a35 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.293468 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fc7b-81a1-4e6a-b6d8-08d5ad888e95 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.321515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.322266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.322963 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.323939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:59.324316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.325968 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.338646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.339561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.340013 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.340452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.348431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.350191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.350835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 403/801] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:59.352503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:59:59.365135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:59.366023 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:59:59.367355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:59.367894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 399/802] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:59.368552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.441072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.472676 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce4e3-f536-4200-80dd-cbb13a9ad303 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.501565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.509313 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de53af-a8fa-4ab5-8e24-4ef36a465338 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.510215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.510893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.511237 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.511573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.512275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:59.513282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.514090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.524330 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 404/803] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:59.525529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.551283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.552087 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.552370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.552639 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.566364 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.567814 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:59:59.583818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:59:59.584815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:59:59.585725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:59:59.585725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:59:59.585725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 10:59:59.585725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 400/804] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:59:59.586510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.636716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96e1bc-d31b-46e2-be6c-f09a9b2b6400 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.669845 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.670497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.670773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.671045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.671760 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:59.672063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.673483 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e3c6f-5af8-4110-8fba-0fdbb3a4fb81 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.675878 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.684971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b864a-2024-46a0-acf2-892331d8407e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.685673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 405/805] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:59.686869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52b6ac-e62a-4bbe-ace8-0964f412f62d None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52b6ac-e62a-4bbe-ace8-0964f412f62d None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52b6ac-e62a-4bbe-ace8-0964f412f62d None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 406/806] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64c46-76d4-42e3-a415-5f021af81722 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64c46-76d4-42e3-a415-5f021af81722 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64c46-76d4-42e3-a415-5f021af81722 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.692663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 407/807] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 10:59:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:59:59.693180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64c46-76d4-42e3-a415-5f021af81722 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.726957 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.727562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.727842 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.728102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.728730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:59.729027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.730418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.735555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 401/808] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:59.736123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.750418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.798153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64c46-76d4-42e3-a415-5f021af81722 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.833782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.834402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.834680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.834956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.835978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8cd20-2c04-4185-9d8a-a664f367f1ab None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:59.836276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:59:59.836576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.837943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49633d4-72e1-40c9-99af-1d9cfcb0ed04 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.849403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 408/809] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 10:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:59:59.850677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe90c-f896-42ca-af10-e160c1d3538c None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.850971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe90c-f896-42ca-af10-e160c1d3538c None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.852073 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe90c-f896-42ca-af10-e160c1d3538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.869192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-2aebe90c-f896-42ca-af10-e160c1d3538c None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:59.869867 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:59.870412 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-2aebe90c-f896-42ca-af10-e160c1d3538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:59.870575 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.870859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.871136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/9c23671f02e94d86b5a9e1e081cfe72f/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.873054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=9c23671f02e94d86b5a9e1e081cfe72f, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:59.874514 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:59.919821 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:59.935882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 409/810] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:59:59.937159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:59.937449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:59.937725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:59.956202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 402/811] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 10:59:59 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/9c23671f02e94d86b5a9e1e081cfe72f/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:59.956202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:59.963141 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:59:59.964493 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:00.043510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 410/812] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 10:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:00.044789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.057372 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:00.096190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc430be-8dc4-4d8e-b4af-fca81b628f4a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.143324 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.144175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.144953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.145228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.145901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.147300 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.216974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045332-f9e6-45de-b47a-53c5f1a2c0f3 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.236831 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:00.253955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 403/813] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 10:59:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:00.253955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.273678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.274352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.274634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.274904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.294403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.295940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:00.322619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:00.323606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:00.324484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 411/814] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:00.335689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.419132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cccccd-039a-40f8-96d8-1c16c239f175 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.457608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:00.475761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.475761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.475761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.475761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] PATH_INFO: `/v3/services/network` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.476173 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.476173 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:00.485179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:00.486244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:00.487059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 404/815] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:00.487868 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49129-38dd-4848-9f5b-af72b629344f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.487944 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.529991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.530631 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.531033 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.531305 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.532111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:00.532853 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.534322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.550964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 412/816] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:00.551996 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.589933 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:00.604148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b478-a939-42aa-81a6-85987348c42b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.639987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.640618 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.640897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.641165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.652894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:00.657533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:00.658480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:00.659692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:00.663667 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 405/817] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:00.664517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.670554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432a6b-11dd-416c-950a-ef0d00247647 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.707871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.708955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.709446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.709998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.711580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] RBAC: Adding query filter params (name=network) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:00.712149 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.713910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.719315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 413/818] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:00.719883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:00.721674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.783123 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a7fa-acaf-4797-a7ca-e8ff85aacf8a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.823936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.824600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.824880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.825154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2d9c65025dcd4c5ab7b61a9daeb0945c/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.840775 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=2d9c65025dcd4c5ab7b61a9daeb0945c, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.842277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.847436 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:00.853691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfc602-31e6-4ab1-bc2e-86cd3d64a043 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:00.887258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:00.887867 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:00.888146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:00.888415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:00.889082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:00.889369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:00.890748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:00.904058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 414/819] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:00.904058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:00.918647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 406/820] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:00:00 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2d9c65025dcd4c5ab7b61a9daeb0945c/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:00:00.920152 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:01.020630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594455ad-8d36-4873-b8e3-a49d45be9fe1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.066752 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.067354 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:01.067630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:01.067897 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:01.069164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] RBAC: Adding query filter params (type=network) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:01.069539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:01.071773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:01.087438 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 415/821] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:01.088729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:01.128734 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e13c-292d-4c17-a442-0ef573cbe9fd None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.131050 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:01.142209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:01.170078 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.170986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:01.171411 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:01.171829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:01.183544 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:01.185321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:01.205099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:01.206184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:01.207047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:01.207047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:01.207047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:01.209301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 407/822] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:01.215586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:01.228988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4957b05-b5ba-4c67-9e74-c9c910ad8308 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.266543 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.267205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:01.267533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:01.267807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:01.268471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:01.269828 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:01.332597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9927-4c7a-43c5-8626-54f89c60620c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.343766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 416/823] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:01.385650 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.386301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:01.386578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:01.386843 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:01.387540 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:01.387841 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:01.389302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:01.404135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 408/824] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:01.409660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:01.554800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:01.577399 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed133ee2-334d-4885-84e9-9775f4cd52bb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.623414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.623966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:01.624244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:01.624513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:01.644025 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:01.645484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:01.661644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:01.662675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:01.664135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 417/825] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 11:00:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:01.671464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:01.684340 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:01.778294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e60f-e8e5-4d56-a217-578d32f27a8a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.823838 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.824450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:01.824725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:01.824998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:01.825727 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:01.826059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:01.827576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaa824-d9bc-4fb7-8a3b-0bfe874da9d1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:01.848453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 409/826] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 11:00:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:01.855065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:01.963210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eb5fc-4309-41e9-857b-b20c2dacc131 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:01.999012 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:01.999936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.000400 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.000853 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.011085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.072513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:02.073991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:02.109393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa12c-10ef-4c86-8518-e6879b192052 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.110012 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa12c-10ef-4c86-8518-e6879b192052 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.110473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa12c-10ef-4c86-8518-e6879b192052 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.115956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 410/827] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:02.118671 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.119190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.119688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.138986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:02.140586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:02.179520 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 418/828] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:02.184591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.226105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.226105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 411/829] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:02.231947 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.297928 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33693638-f441-430e-bb17-8e6aef5039d9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:02.334327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:02.334987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.335302 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.335587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.347698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:02.349154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f8feb051-a675-463f-9dcc-9e313927309e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:02.365343 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:02.366292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:02.368071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:02.368071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:02.368071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:02.368071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 419/830] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:02.375007 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.482269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf395-ebf5-443f-8015-25fcfb463c19 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:02.487441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8a0a-4935-42c2-9183-84ebd01ec808 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.487730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8a0a-4935-42c2-9183-84ebd01ec808 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.488009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8a0a-4935-42c2-9183-84ebd01ec808 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.489611 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 420/831] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:02.495176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.495463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.495739 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.518796 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:02.518988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:02.519598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.519872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.520038 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:02.520149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.520769 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:02.521067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:02.522448 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:02.534114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 412/832] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:02.534935 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.593963 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 421/833] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:02.594881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.605658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.630370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.660055 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff801e-0896-4c53-86f4-fd5ec3ceeec7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:02.708755 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:02.709822 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3c981-7efe-463f-ac5b-3275ecb162f0 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:02.710659 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.711186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.711787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.725338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:02.732453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:02.733408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:02.734262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:02.739822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 413/834] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:02.741412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.753363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:02.754380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.754884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.755371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.763505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:02.765238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:02.777815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:02.778706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:02.779577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:02.786050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 422/835] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:02.787860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.870169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b593fb-699e-4386-90af-9ccf39c6bf7d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:02.877939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.887571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:02.897472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65002e00-79b8-4f93-9d03-2f561a109527 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:02.904553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:02.905158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.905431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.905698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.906385 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:02.906686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:02.908101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:02.921477 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 414/836] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:02.921477 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:02.933150 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:02.933769 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:02.934085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:02.934363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:02.935059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:02.935371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:02.936790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:02.954126 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 423/837] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:02.954126 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.027295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a65d1-1ac4-48dd-86af-99b9612f3ff9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.057798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e49ae-282e-4977-99c8-ee44240f30d6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.062968 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.063601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.063886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.064165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.064757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.066154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:03.075556 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:03.081378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:03.082292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 415/838] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:03.083073 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.099218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.099852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.100135 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.100409 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.110055 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:03.111957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.114054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:03.128577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:03.139615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:03.140482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:03.140482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:03.140482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:03.140482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 424/839] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:03.140482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.140818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:03.198589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b2a7c-8b7f-461d-b609-c6f182ae45b2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.232494 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf01af-2c23-451b-a71a-396dd9eb1250 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.232726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.233333 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.233613 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.233887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.234641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=eb9bed06ddf345e7aa00bde7a8ad770b) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:03.234950 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.236380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.243403 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 416/840] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/role_assignments?user.id=eb9bed06ddf345e7aa00bde7a8ad770b&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:03.244224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.268647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.269281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.269559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.269835 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.270529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:03.270844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.272245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7055f5-3d28-4818-8b6f-3d1ca934b1f3 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.282517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 425/841] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:03.282517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33770-01c0-409d-92c6-598fcb6ea480 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.282517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33770-01c0-409d-92c6-598fcb6ea480 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.282517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33770-01c0-409d-92c6-598fcb6ea480 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.282517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 426/842] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:03.286182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f33770-01c0-409d-92c6-598fcb6ea480 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.352682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:03.385320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edc3b1-148d-4457-a815-92c3296ce7f7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.395751 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:03.403544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f33770-01c0-409d-92c6-598fcb6ea480 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.425562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.426524 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.426955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.427243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.427936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:03.428461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.430780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83a28-5d86-471c-828f-4ea51a8f98e5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.446195 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.446827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.447114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.447389 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.448027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:03.448330 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.448745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 417/843] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:03.449730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.451444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.451444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.451444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.456217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 427/844] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:03.456217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.471811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:03.473257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:03.574138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 418/845] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:03.587756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb90e9b-a31e-4020-ab19-d12d16d40775 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.612988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:03.624799 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.625435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.625766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.626074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.635246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.636697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:03.648688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:03.649643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:03.650740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 428/846] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:03.655658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.763268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:03.767183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e348d-511c-446b-bddd-2ec0d27bdb0b None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.803206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:03.804708 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:03.805188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:03.805750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:03.806709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:03.807214 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:03.808849 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:03.827624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 419/847] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:03.833950 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.877837 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:03.959494 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90d6c3-e09a-4d1a-8766-48adb637120b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:03.997988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c880-9217-4a68-8c37-b07d4c68b72f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.002944 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.003783 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.004258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.004723 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.046695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.047587 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.047872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.048147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.061539 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:04.064901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:04.068732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:04.070196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:00:04.071021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:04.074066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 420/848] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:04.077135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.096666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.098334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.102600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.212153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46beb31-e08b-4d8c-9230-c34bfe2803fc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.222918 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 429/849] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:04.228765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.252682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.253289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.253571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.253845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.254608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:04.254833 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.256263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.269140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 421/850] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:04.270148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.323709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.344873 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec44b2-fcbe-4c7e-a082-ab6aa8c5268b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.353409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.378375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77502-6ed0-415d-bedc-40b5d991af4c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.384113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.385255 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.385675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.386151 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.397311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.399474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.416348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:04.416814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:04.417893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:04.418992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:04.418992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:04.418992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:04.419194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.419194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.419521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.421393 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 430/851] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:04.428209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.440612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.445560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:04.463068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:04.464040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:04.464936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:04.464936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:04.464936 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:04.467269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 422/852] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:04.472699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.547236 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1ba76-748b-4625-abcd-ffc7778fa389 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.579366 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.584757 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.585614 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.585900 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.586220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.586876 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:04.587222 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.588546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.603172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 431/853] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:04.608647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.609218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be0cdd-7ecb-4079-9d0a-68c7cce11f6b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.649250 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.659017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.659877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.660354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.660846 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.662229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:04.662779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.665663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.688273 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 423/854] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:04.689451 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.750807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359021fa-bfa3-4ad3-82c2-0289b6772456 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.799620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.800535 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.800869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.801150 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.810663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.812690 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.825776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573244a-e576-43d2-b0f8-8e34c1b9b430 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:04.828403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:04.829268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:04.830187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 432/855] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:04.835820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.866128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:04.866716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:04.866997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:04.867273 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:04.876946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:04.878664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:04.893871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:04.894876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:04.896373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 424/856] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:04.900907 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:04.914092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.963670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:04.985157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa089-5862-40d9-8a13-2e16a87d7ed5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.021417 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.022057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.022395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.023201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.023931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:05.024234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.025711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.029816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705dc9a-626b-4718-9969-0c67c46b75d3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.039171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 433/857] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:05.046951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.073183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.074398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.074830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.075485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.076368 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:05.076948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.079310 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.107604 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 425/858] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Aug 12 11:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:05.108637 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.175638 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada166c-f638-409a-b8f7-1cb2a2aab585 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.193470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:05.215466 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adeab2-2879-4d9c-96b8-e3268ca64df7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.220840 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.221635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.222090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.222505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.223383 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=9c23671f02e94d86b5a9e1e081cfe72f) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:05.223859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.226210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12950c-823b-4ccc-bca4-7bd22b9dd7bd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.227230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:05.236682 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 434/859] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/role_assignments?user.id=9c23671f02e94d86b5a9e1e081cfe72f&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:05.258367 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4115-727d-409f-832b-515d69ca2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.259298 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4115-727d-409f-832b-515d69ca2846 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.259724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4115-727d-409f-832b-515d69ca2846 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.260140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4115-727d-409f-832b-515d69ca2846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.267626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2412f-bfba-4f54-81df-1b428141b615 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.267910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2412f-bfba-4f54-81df-1b428141b615 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.268187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2412f-bfba-4f54-81df-1b428141b615 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.274304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 435/860] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:05.275719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.275999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.276275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.297169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:05.298443 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:05.356590 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a4115-727d-409f-832b-515d69ca2846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.358909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a4115-727d-409f-832b-515d69ca2846 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.378379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 436/861] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:05.469482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 426/862] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:05.475583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.477898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0aeb-d086-41e0-803b-a51a200bcadb None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.478217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0aeb-d086-41e0-803b-a51a200bcadb None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.478496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0aeb-d086-41e0-803b-a51a200bcadb None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.480102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 427/863] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:05.485101 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.485391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.486049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.505958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:05.509438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:05.510570 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:05.576668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 428/864] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:05.598380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b83384-7ea0-4a7c-9912-a9fb774fd4b3 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.606345 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:05.634312 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.635098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.635473 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.635841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.646489 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.646888 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.649088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:05.668844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:05.669806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:05.670728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:05.670728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:05.670728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:05.670728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 437/865] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:05.675801 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.751674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f67c-4b8d-495c-9380-6babbf50f008 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.787410 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.789022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.789501 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.790032 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.790830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.792654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.793936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a356c-b8c1-4302-aced-891ee03edfd4 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:05.802382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:05.803348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:05.804297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:05.807198 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 429/866] 10.222.0.40 () {56 vars in 1132 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:05.812967 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.816019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:05.838675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.839293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.839575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.839849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.840509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:05.840834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.842204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.856783 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 438/867] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:05.858754 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.881023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:05.923374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46db51f-78ec-414f-8cd0-c2d83ea20332 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:05.956935 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:05.957569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:05.957850 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:05.958150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:05.958782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:05.959086 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:05.961345 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:05.969956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 430/868] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:05.969956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:05.974404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952b38b-74d5-4f34-9302-2008ca76d1bc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:06.012807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:06.013344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:06.013619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:06.013891 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:06.014559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:06.015920 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:06.034561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:06.067964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70013f1-7c9d-43ab-8a92-6601c75c00fc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:06.084976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 439/869] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:05 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:06.088985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:06.121211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:06.122316 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:06.122823 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:06.123307 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:06.131583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:06.134082 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:06.149885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:06.150858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:06.151773 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:06.154319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 431/870] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:06.166391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:06.190675 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:06.216060 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23e59-aa8e-4e8c-8484-55ea4b33359a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:06.255484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:06.256981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:06.257272 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:06.257548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:06.258381 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:06.258908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:06.260092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:06.264998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 440/871] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:06.283768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c6217-41c0-4b3a-b890-d54aff16159b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:06.312632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:06.325719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:06.326385 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:06.326662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:06.326932 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:06.327644 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:06.329227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:06.329506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007ce54-2fa4-410b-b833-7aa180f1b9bb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:06.344870 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 432/872] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:06.351309 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:06.469117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2162fd-7348-4b4d-bc46-605af12f1bc8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:06.504479 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:06.505117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:06.505356 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:06.505630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:06.506399 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2d9c65025dcd4c5ab7b61a9daeb0945c) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:06.506711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:06.508827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff370f5-e52c-45c0-890a-8d360381b538 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:06.515313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 441/873] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:06 2022] GET /identity/v3/role_assignments?user.id=2d9c65025dcd4c5ab7b61a9daeb0945c&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:07.299640 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b15c-1700-425b-8c70-3170f6cff8b7 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:07.300260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b15c-1700-425b-8c70-3170f6cff8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:07.300260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b15c-1700-425b-8c70-3170f6cff8b7 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:07.301523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 433/874] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:07.307735 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:07.308140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:07.308515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:07.322581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:07.328473 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:07.329780 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:07.406905 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 442/875] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:07.679727 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b15c-1700-425b-8c70-3170f6cff8b7 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:07.787400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b15c-1700-425b-8c70-3170f6cff8b7 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:07.823585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:07.824571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:07.825048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:07.825541 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:07.826349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:07.827914 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:07.837155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:07.838147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:07.838990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:07.841675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 434/876] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:07.847456 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:07.956626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8335be-d0b8-4503-bf38-2718752eb90d None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:07.994026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:07.994644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:07.994926 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:07.995197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:07.995836 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:07.996142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:07.997508 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13917d2-298a-4dad-ac50-5df43cbee0a7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:07.999337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.002764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 443/877] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:08.011260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:08.062522 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.119155 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200b5fb-83cb-4747-be64-fb11c938d756 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:08.159428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:08.160310 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.160741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.161160 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.161987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:08.162434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:08.164065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdac16-c3fd-42c8-a02c-82e03a073442 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:08.169603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 435/878] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:08.233224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e10ca-dccb-4de6-b925-81aa54162c21 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.233600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e10ca-dccb-4de6-b925-81aa54162c21 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.234047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e10ca-dccb-4de6-b925-81aa54162c21 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.235889 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 444/879] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:08.242674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895671-7748-4b30-938c-1297df5384b3 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.243125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895671-7748-4b30-938c-1297df5384b3 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.243504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895671-7748-4b30-938c-1297df5384b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.263154 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-8a895671-7748-4b30-938c-1297df5384b3 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:08.264376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-8a895671-7748-4b30-938c-1297df5384b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:08.333049 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe652c-f5ed-47bb-b54c-a0c2ec779513 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.333491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe652c-f5ed-47bb-b54c-a0c2ec779513 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.333782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe652c-f5ed-47bb-b54c-a0c2ec779513 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.336643 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 445/880] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:08.340142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 436/881] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:08.352712 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82160d-3eff-4445-ba45-d5f8ef9d55e4 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.353226 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82160d-3eff-4445-ba45-d5f8ef9d55e4 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.353677 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82160d-3eff-4445-ba45-d5f8ef9d55e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.372900 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-cd82160d-3eff-4445-ba45-d5f8ef9d55e4 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:08.374402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-cd82160d-3eff-4445-ba45-d5f8ef9d55e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:08.453935 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 446/882] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:08.522587 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74996ed-f324-4641-a337-c6100ec6a5bf None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.523244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74996ed-f324-4641-a337-c6100ec6a5bf None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.523719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74996ed-f324-4641-a337-c6100ec6a5bf None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.525536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 437/883] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:08.530572 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.530859 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.531137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.550693 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:08.551883 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:08.620820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 447/884] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:08.645334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74996ed-f324-4641-a337-c6100ec6a5bf None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:08.691636 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.748833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:08.753393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74996ed-f324-4641-a337-c6100ec6a5bf None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:08.791830 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:08.792441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.792726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.792997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.793685 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:08.795206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:08.805504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:08.806563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:08.807376 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 438/885] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:08.812172 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.813118 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:08.857408 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bf7cd-7807-4ced-a626-f6e1ca640d8f None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:08.895257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:08.895951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.896233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.896499 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.897148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:08.899163 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:08.942964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68696f83-b84f-47c1-aa49-29d7b7d0f98e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:08.945897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.971551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 448/886] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:08 2022] POST /identity/v3/services => generated 269 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:08.972753 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:08.995781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:08.996858 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:08.997136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:08.997460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:08.998169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:08.998474 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.000718 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.009462 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 439/887] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:09.014960 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.108513 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bdb4e-19d0-4fb0-a8ad-8f2b6d837d2e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.138679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.145737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275351e3-9d33-43d1-9ebe-2fcf7b1ea0d6 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.159495 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.160134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.160421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.160696 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.175592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:09.182059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:09.183078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:09.187219 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 449/888] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Aug 12 11:00:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:09.189106 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.195732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.196356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.196641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.196916 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.197557 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:09.197865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.199255 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.205031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 440/889] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:09.212848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.247720 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.330437 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070194fa-ec86-4a9a-9894-cbcb8d60096b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.346960 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb126-429f-47ad-92e6-d52a02cf960e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.370917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.371666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.372050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.372517 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.373331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:09.373741 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.375251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.387982 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 450/890] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:09.390620 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.392263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.392975 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.393332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.393770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.394700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] RBAC: Adding query filter params (interface=public, service_id=d470902e5dc744e79dc0f7dd9db12eaa, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:09.395124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.396741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.407622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 441/891] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/endpoints?service_id=d470902e5dc744e79dc0f7dd9db12eaa&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:09.408772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.439465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.504276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d3e01-4772-4dbf-9c78-d86820e3da10 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.521786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58db35-ee28-4524-93b9-6edc75a08cdc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.530280 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.542045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.542688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.542975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.543251 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.554678 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.556283 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.561650 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.562519 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.563014 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.563491 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.564295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.565904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:09.572510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:09.573471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:09.574433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:09.574433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:09.574433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:09.581981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 451/892] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:09.581981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.582610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 442/893] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:00:09.692541 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.700992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49943a-d05a-47b3-aaaa-6e838751edce None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.742698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.743685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.744164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.744446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.745098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:09.745403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.746871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.760192 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 452/894] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:09.765885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:09.874388 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655407f-2cf5-44b0-8746-3ccbd79cb66a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:09.910844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:09.912853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:09.913249 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:09.913848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:09.921753 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:09.923303 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:09.935702 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:09.936875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:09.938063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:09.939035 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 443/895] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:09.946014 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:10.059452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396929-1092-45df-a8f4-4491d3a462f7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:10.096533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:10.097647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.098100 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.098541 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.099420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:10.099938 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:10.102193 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f04209-d72f-4da5-9687-bb6e83787159 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:10.122123 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 453/896] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Aug 12 11:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:10.129941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:10.159119 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:10.169312 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc4e5-f9b7-4d9f-bb34-f704c67c402c None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.169592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc4e5-f9b7-4d9f-bb34-f704c67c402c None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.169860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc4e5-f9b7-4d9f-bb34-f704c67c402c None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.171480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 454/897] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:10.176352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.176632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.181617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.195427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:10.196655 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:10.204552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:10.252165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9108e-7495-44cd-be8e-13e7fa4dec00 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:10.278311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 455/898] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:10.291334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:10.291946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.292284 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.292557 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.361592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:10.363146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:10.380378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:10.464632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 444/899] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:10 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:10.470377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:10.566233 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:10.580196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021231c-3ee6-4f47-b439-a405ed611cd9 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:10.626302 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:10.627262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.627810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.628086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.642098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:10.643554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:10.645815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:10.665119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:10.666546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:10.670973 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:10.670973 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:10.670973 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:10.670973 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 456/900] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:10.674124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:10.676524 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fd01-2deb-40a4-95e5-35920d5d18e0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:10.703397 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:10.718599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:10.719478 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.719965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.720458 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.721426 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:10.723090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:10.787178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e270e-7b8c-4acc-95b1-435e2ca65ceb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:10.793531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 445/901] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:10 2022] POST /identity/v3/services => generated 241 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:10.838803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:10.839429 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.839715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.839987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:10.840712 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:10.841088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:10.842559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a03f-96af-47b0-bcf4-b9efd24ddcae None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:10.857565 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 457/902] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:10.863617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:10.977537 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad02b8-fb3c-4547-9a5c-4989c4928e1a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:10.997953 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b94db-d552-466e-8f5a-a50b50a84b9e None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:10.998471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b94db-d552-466e-8f5a-a50b50a84b9e None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:10.998590 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b94db-d552-466e-8f5a-a50b50a84b9e None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.000087 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 458/903] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:11.004902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.005191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.005467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.017772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:11.018571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.018954 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.019363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.024812 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:11.026237 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:11.027523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:11.029320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:11.043371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:11.044485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:11.045563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:11.052352 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 446/904] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:11.054451 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:11.079130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:11.094997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:11.102742 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 459/905] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:11.168244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084feed2-e795-47d5-83f0-b2e7228c6270 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:11.205353 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:11.206044 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.206328 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.206603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.207301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:11.207607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:11.209111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:11.227145 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 447/906] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:11.228645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:11.335853 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11fa20-f2c2-4784-b1ec-b46513dca7b6 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:11.372597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:11.373207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.373537 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.373818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.374579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] RBAC: Adding query filter params (role.id=050e5bd9ca5147bb8e4f67bcd351c367, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2d9c65025dcd4c5ab7b61a9daeb0945c) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:11.374890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:11.376325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:11.381908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:11.384139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 460/907] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:11 2022] GET /identity/v3/role_assignments?user.id=2d9c65025dcd4c5ab7b61a9daeb0945c&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=050e5bd9ca5147bb8e4f67bcd351c367 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:11.498243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:11.504287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9e81-3890-4654-a57d-fa9059dc6a49 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:11.544490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:11.545260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.545548 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.545822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.546447 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:11.547822 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-62e51973-50bd-4eed-b9e8-972de979b0e0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:11.557181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:11.558142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:11.559051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 448/908] 10.222.0.40 () {56 vars in 1132 bytes} [Fri Aug 12 11:00:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:11.566416 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:11.616887 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:11.665476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b16a-db13-45c1-9957-cf3e310170b5 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.665813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b16a-db13-45c1-9957-cf3e310170b5 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.666370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b16a-db13-45c1-9957-cf3e310170b5 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.667820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 449/909] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:11.672761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.673049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.673323 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.677608 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51da1-bedb-4eeb-9ee1-95e14dc2a747 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:11.691786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:11.693070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:11.722967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:11.723582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.723860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.724129 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.724758 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:11.725057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:11.726496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:11.735690 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 461/910] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:11.742640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:11.768370 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 450/911] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:11.861397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e9f69-9813-46fc-97b1-4c0cb10e5af6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:11.871475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:11.897092 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:11.897737 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:11.898051 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:11.898322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:11.898957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:11.899257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:11.900632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:11.910313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 462/912] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:11.912476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:12.015321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:12.028185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858a12-8684-4782-be89-e6029caf2b05 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:12.040617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:12.063562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:12.064170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.064444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.064710 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.065408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] RBAC: Adding query filter params (interface=public, service_id=40d89e1c865e49ca9574da2c8f531a71, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:12.065714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:12.067231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:12.073678 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 451/913] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 11:00:11 2022] GET /identity/v3/endpoints?service_id=40d89e1c865e49ca9574da2c8f531a71&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:12.080149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:12.168671 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453cfa-7a5a-410b-8291-800fa46e325d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:12.211981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e560ed8-f1d7-4ade-bd07-d3bff688bc20 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:12.214599 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:12.215250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.215552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.216748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.217420 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:12.218825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:12.233981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:12.235113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:00:12.236020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:12.237256 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 463/914] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:12.238952 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:12.263542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:12.264606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.265062 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.265598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.266442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:12.267958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:12.275964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 452/915] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:00:12 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:00:12.289806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:12.362837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9692-2433-4a48-aa41-d87db567256f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:12.404359 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:12.404985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.405266 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.405542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.406247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:12.406555 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:12.407954 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:12.414640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 464/916] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:12.420741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:12.444779 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:12.533860 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fc6a1-c309-4956-903a-703d62666ec6 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:12.570152 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:12.570789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.571071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.571346 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.571989 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:12.572293 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:12.573653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fba4d-c076-43c6-96ef-f62c1fd2d061 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:12.579342 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 453/917] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Aug 12 11:00:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:12.585912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:12.718623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b52fe8-d248-40d0-b677-554cbba06e88 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:12.722225 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:12.784984 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:12.785600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.785882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.786183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.786854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:12.788423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:12.856529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93fd5-3a85-4c15-a0e1-f6426505514c None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.856717 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93fd5-3a85-4c15-a0e1-f6426505514c None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.856988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93fd5-3a85-4c15-a0e1-f6426505514c None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.858616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 454/918] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:12.863675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:12.863814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 465/919] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:12.863915 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:12.864176 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:12.886991 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:12.888210 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:12.996456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 455/920] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:13.290819 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:13.395261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29d52-990e-485f-8ccd-c9d693e0d4f7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:13.430836 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:13.431475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:13.431757 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:13.432034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:13.432636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:13.434137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-89f40e3b-b13a-4dc4-8250-b8595dc0aed4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:13.443242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:13.444270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:13.445544 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 466/921] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:13.452363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:13.463401 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:13.493050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb545-bca2-4c6b-ab29-9cedb53ab2aa None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:13.493573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb545-bca2-4c6b-ab29-9cedb53ab2aa None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:13.494031 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb545-bca2-4c6b-ab29-9cedb53ab2aa None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:13.500144 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 467/922] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:13.502558 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:13.503165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:13.503454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:13.527126 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:13.528938 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:13.549534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:13.571862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754ef8-948d-4bf0-8423-56cb1f18425f None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:13.617530 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:13.618731 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:13.619527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:13.620240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:13.621077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:13.621594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:13.623433 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:13.626002 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 468/923] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:13.633909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 456/924] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:13.642106 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:13.739871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5f763-d7da-4c34-9266-59651f67a0df None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:13.774552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:13.775428 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:13.775904 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:13.776370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:13.777212 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:13.777710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:13.779280 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:13.784581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 469/925] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:13.790573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:13.866114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:13.900885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734dabc-337c-4ecf-8a96-838b51057e8f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:13.919746 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:13.936001 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:13.939690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:13.940584 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:13.941087 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:13.941597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:13.942554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] RBAC: Adding query filter params (interface=public, service_id=c71456396fff47e1a251c77e583b8cb7, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:13.943599 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:13.947049 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:13.967250 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 457/926] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 11:00:13 2022] GET /identity/v3/endpoints?service_id=c71456396fff47e1a251c77e583b8cb7&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:13.967250 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.068720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19909-8c71-4871-942d-9caf7d909ee8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.090298 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f110a4-eeac-441e-aa7a-e00fb15aaca5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.115107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:14.117401 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.117882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.118344 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.127674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:14.128423 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.128808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.129182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.129883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:14.131465 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:14.132923 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:14.133736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:14.138803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:14.140088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:14.140998 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:14.143369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 470/927] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Aug 12 11:00:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:14.150177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 458/928] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:00:13 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:00:14.155403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.242308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:14.271664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b1e7-a2dd-4824-b5ff-277f93b0b99f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.314722 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:14.316029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.316315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.316591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.317265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:14.317571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:14.319511 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d357-c5b8-40ee-8738-4a94ecebcae5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:14.328579 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 471/929] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:00:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:14.335068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.449270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494401bb-8db7-4c8f-a436-d95d66692125 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.469071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304a0af-86c3-4e88-9928-bc94e7557ad9 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.469402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304a0af-86c3-4e88-9928-bc94e7557ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.469626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304a0af-86c3-4e88-9928-bc94e7557ad9 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.471274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 472/930] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:14.476830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.477107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.477379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.487494 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:14.488137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.488420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.488694 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.495506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:14.496689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:14.502196 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:14.503670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:14.529008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:14.530080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:14.530956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:14.530956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:14.530956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:14.531140 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 459/931] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:14.536115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.577475 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 473/932] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:14.599904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:14.654220 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33342561-d65a-49c2-a9c4-ccf1617575ac None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.692707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:14.693248 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.693533 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.693811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.695286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:14.695658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:14.697131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:14.710525 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 460/933] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:14.715628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.788110 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:14.823881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cecf9-82c2-40cb-b8aa-3dfb79913fcf None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.845179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.868604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:14.869837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:14.870154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:14.870713 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:14.881374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:14.884120 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:14.898827 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:14.899790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:14.900725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:14.904710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 474/934] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:00:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:14.905550 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:14.967580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce54d94-c28c-497f-9c3e-f84fcc487307 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:14.981435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.004095 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.004750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.005027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.005294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.005953 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.007426 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:15.017203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:15.019431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:00:15.021547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:15.024567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 461/935] 10.222.0.40 () {56 vars in 1132 bytes} [Fri Aug 12 11:00:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:15.034141 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.034238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc903ec-c92c-4f3e-a791-dc6e98978058 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.062249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.072075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.072691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.076602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.076602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.076602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:15.076602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.076602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972090b8-6340-4055-8a1d-20092264d654 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.092800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 475/936] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Aug 12 11:00:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:15.093806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c480-6be1-4ba7-9abf-c51f396567f2 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.094121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c480-6be1-4ba7-9abf-c51f396567f2 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.094393 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c480-6be1-4ba7-9abf-c51f396567f2 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.098601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 476/937] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:15.099808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83c480-6be1-4ba7-9abf-c51f396567f2 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.137182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509230-df56-4649-96b0-1bbc0249229a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.180713 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.181434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.181723 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.182024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.182658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:15.182962 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.184330 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c3a96-36e1-477e-a8e0-606c54713952 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.189089 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 462/938] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:15.190275 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.190560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.190834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.208935 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:15.210627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:15.224375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83c480-6be1-4ba7-9abf-c51f396567f2 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.257149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.265042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.265676 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.265977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.266249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.276652 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.279961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.301347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 463/939] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:15.301347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:15.301660 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:15.302730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:15.303914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:15.303914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:15.303914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.303914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 477/940] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:15.305213 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.343218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.421809 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951996d-1dd5-41c8-8b29-1181761a47e1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.425615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2b33-2757-4d9d-94a6-db84f2097677 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.463941 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.464548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.464824 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.465098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.465900 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:15.466227 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.468207 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.474869 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.475783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.476288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.476782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.477624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:15.478209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.479774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.486063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 478/941] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:15.487945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.490507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 464/942] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:15.496317 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.537814 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.596104 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.602221 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac441f-031e-4c90-9e2d-e5dea2bccfc9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.626192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51eee3-b361-4400-9379-86e4808ba875 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.639510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.640143 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.640424 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.640696 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.648224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.649818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:15.660808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:15.661726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 479/943] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:15.667240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.668627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.669256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.669534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.669859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.670867 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.673224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.769315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c720-b9c7-4a6d-8b84-67dbae58629a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.785948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 465/944] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:15.785948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.815854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.816472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.816751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.817023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.817674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.819879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:15.822799 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: WARNING keystone.server.flask.common [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 11:00:15.868306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.sql.core [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:00:15.868306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 11:00:15.868306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [parameters: {'id': '222934adc3514bff971bfbdd43cc6f23', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 11:00:15.868306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81711) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 222934adc3514bff971bfbdd43cc6f23.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 222934adc3514bff971bfbdd43cc6f23. Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:00:15.890580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application result.read() Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 12 11:00:15.891472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application yield resource Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise self.value Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application session.commit() Aug 12 11:00:15.892405 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:00:15.893274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:00:15.894182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application result.read() Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:00:15.895108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [parameters: {'id': '222934adc3514bff971bfbdd43cc6f23', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.896202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:15.897217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 222934adc3514bff971bfbdd43cc6f23. Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:15.898575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 480/945] 10.222.0.40 () {60 vars in 1140 bytes} [Fri Aug 12 11:00:15 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:15.900474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:15.919935 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.924884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:15.935665 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c854496-ed4f-4158-aff3-4905fcd70e6d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:15.984601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:15.985314 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:15.985589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:15.985855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:15.987026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:15.987026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:15.988279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:16.007149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 466/946] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:16.013061 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:16.030684 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69cc2-51ed-4349-96bf-bcc73c124bf2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:16.066106 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:16.066914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.067196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.067467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.075246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:16.077029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:16.088478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:16.089422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:16.090357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:16.094707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 481/947] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:16.095993 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:16.137387 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e9ee2-9bad-4491-9aa6-c77b52bba3c8 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:16.165501 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:16.173965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:16.174622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.174901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.175180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2d9c65025dcd4c5ab7b61a9daeb0945c/roles/050e5bd9ca5147bb8e4f67bcd351c367` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.177398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=2d9c65025dcd4c5ab7b61a9daeb0945c, role_id=050e5bd9ca5147bb8e4f67bcd351c367)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:16.178981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:16.200602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76d85-cbf1-42fb-93b8-054f511ada9a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:16.234977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:16.235577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.235854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.236124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.236776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:16.237163 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:16.238614 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447270c3-614c-4452-b057-fcced076c6d1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:16.259443 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 482/948] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:16.261950 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48f86e-7c58-4792-b194-6c230a4bdc76 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.262249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48f86e-7c58-4792-b194-6c230a4bdc76 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.262525 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48f86e-7c58-4792-b194-6c230a4bdc76 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.264005 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 483/949] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:16.269647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.270054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.270337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.283380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 467/950] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:00:16 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2d9c65025dcd4c5ab7b61a9daeb0945c/roles/050e5bd9ca5147bb8e4f67bcd351c367 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:00:16.299403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:16.300992 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:16.387939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 484/951] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:16.658469 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:16.673297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:16.769759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bdb4-726b-4745-9544-a48fd0f57765 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:16.805644 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:16.806583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.807009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.807446 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.808180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:16.809683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:16.819913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:16.821399 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:16.822527 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:16.824904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 468/952] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:16.830811 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:16.891715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:16.937564 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db54ea3-7009-49bd-a32b-47b5416f4ac8 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:16.973767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:16.974419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:16.974699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:16.974974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:16.975644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:16.975951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:16.977321 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:16.982666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 485/953] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:16.988353 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:17.070075 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:17.096711 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c05db9-f78f-4e70-afde-130eb9968704 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:17.131703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:17.132610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:17.133093 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:17.133598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:17.134460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:17.134982 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:17.136552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2d447-0b45-4ddb-8ccf-9347813f3f97 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:17.142088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 469/954] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:17.148534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:17.252122 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520198-4211-4153-9345-cc45f7986839 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:17.275370 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:17.287090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166c3e-4b1e-4743-bb92-4ea0d7d23366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:17.287837 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166c3e-4b1e-4743-bb92-4ea0d7d23366 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:17.288304 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166c3e-4b1e-4743-bb92-4ea0d7d23366 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:17.288753 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166c3e-4b1e-4743-bb92-4ea0d7d23366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:17.289470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82166c3e-4b1e-4743-bb92-4ea0d7d23366 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:17.290869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82166c3e-4b1e-4743-bb92-4ea0d7d23366 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:17.348872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 486/955] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:17.782344 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d4c7-f5e2-4d2e-bcbc-e46fbf127a81 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:17.782881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d4c7-f5e2-4d2e-bcbc-e46fbf127a81 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:17.782881 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d4c7-f5e2-4d2e-bcbc-e46fbf127a81 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:17.784426 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 470/956] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:17.790336 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a7b0-db63-4da1-ac68-9a3763e125a5 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:17.790798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a7b0-db63-4da1-ac68-9a3763e125a5 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:17.790879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a7b0-db63-4da1-ac68-9a3763e125a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:17.810062 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-46e0a7b0-db63-4da1-ac68-9a3763e125a5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:17.811239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-46e0a7b0-db63-4da1-ac68-9a3763e125a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:17.890399 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 487/957] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:18.156847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901d4c7-f5e2-4d2e-bcbc-e46fbf127a81 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:18.266372 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901d4c7-f5e2-4d2e-bcbc-e46fbf127a81 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:18.302491 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:18.303651 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.304136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.304703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.305507 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:18.307109 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:18.314605 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6543-6af3-448e-87df-d3492750861c None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.314888 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6543-6af3-448e-87df-d3492750861c None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.315161 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6543-6af3-448e-87df-d3492750861c None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:18.317486 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:18.318485 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:18.319897 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:18.320794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 488/958] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:18.322140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ae7d-126f-4bd2-ba35-5db7398a66da None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.322424 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ae7d-126f-4bd2-ba35-5db7398a66da None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.322696 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ae7d-126f-4bd2-ba35-5db7398a66da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.323531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 471/959] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:18.329165 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:18.333113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:18.345943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-7b74ae7d-126f-4bd2-ba35-5db7398a66da None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:18.347119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-7b74ae7d-126f-4bd2-ba35-5db7398a66da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:18.426983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 489/960] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:18.431357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560a48-a5d2-4564-80a6-95ccb06c3700 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.431644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560a48-a5d2-4564-80a6-95ccb06c3700 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.431921 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560a48-a5d2-4564-80a6-95ccb06c3700 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.433402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 490/961] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:18.440884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.444626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.444626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.451660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d16f9-2c43-4939-b148-44faa97bf6f7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:18.474046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:18.475346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:18.493359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:18.494312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.494798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.495271 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.496096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:18.496613 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:18.498210 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:18.503400 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:18.503857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 472/962] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:18.509142 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:18.554731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 491/963] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:18.585726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:18.621937 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69081b-6a2d-49ec-a11f-9b03ab98a3c7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:18.656200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:18.657040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.657495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.657961 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.658787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:18.659260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:18.660792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:18.666642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 473/964] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:18.701108 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:18.814441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c7ab8-a3f3-4620-a11b-3b8b5a1e12c6 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:18.851961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:18.852897 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:18.853351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:18.853793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:18.855660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:18.867979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:18.873292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:18.874250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:18.875069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:18.877413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 492/965] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Aug 12 11:00:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:18.883947 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:18.913244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:18.986035 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8821cc-bc9d-42fb-b531-3a3f42ce2fd5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.014596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38789a6-62b3-48a8-9699-16691ccbf0d9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.022112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:19.028855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.029529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.030157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.030441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.031420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.033024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.039608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: WARNING keystone.server.flask.common [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 11:00:19.057371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.058009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.058290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.058559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.059216 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:19.059551 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.060868 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.070280 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 493/966] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:00:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:19.075773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.107653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.sql.core [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:00:19.107653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 11:00:19.107653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [parameters: {'user_id': '045bdcc1c4534cbf8f0368025b25a935', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 11:00:19.107653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81712) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result.read() Aug 12 11:00:19.118183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:00:19.119094 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application yield resource Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise self.value Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application session.commit() Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:00:19.120065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:00:19.120941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:00:19.122500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application result.read() Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:00:19.123610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [parameters: {'user_id': '045bdcc1c4534cbf8f0368025b25a935', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:19.124656 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 12 11:00:19.125622 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 12 11:00:19.126801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 12 11:00:19.126801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 12 11:00:19.126801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:00:19.126801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:00:19.126801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 11:00:19.126801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.130758 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 474/967] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Aug 12 11:00:18 2022] POST /identity/v3/users => generated 160 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:19.136538 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.187150 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:19.208445 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d5f3-40f5-4aec-9551-93f40f691aa8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.247476 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.248657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.249101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.249518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.252617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05869d-9651-4b3c-9821-76de3392d9c5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.262053 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.264279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:19.280116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:19.281279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:19.282333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:19.282333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:19.282333 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:19.284147 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 494/968] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:19.290896 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.292857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.293784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.294251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.294777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.302703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.304857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-0ea62b49-011d-4558-8797-867fe7244ced None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:19.319190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:19.320359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:00:19.321412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.323438 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 475/969] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:19.324977 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da2557-f2ac-420f-8192-b57668d21a02 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.325418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da2557-f2ac-420f-8192-b57668d21a02 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.325833 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da2557-f2ac-420f-8192-b57668d21a02 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.330428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 476/970] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:19.331328 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da2557-f2ac-420f-8192-b57668d21a02 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.388202 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:19.403808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9a56c-c0e5-4624-98c5-9bad3a08d78b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.443229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da2557-f2ac-420f-8192-b57668d21a02 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.445158 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.445771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.446069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.446338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.446979 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:19.447275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.448627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f59b4-c34d-42e9-bdc1-d2b01cf11f40 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.456191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:19.466591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 495/971] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:19.467880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.471197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.471197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.486969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:19.488307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:19.488483 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.489787 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.490103 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.490379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.491543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:19.491852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.493649 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.538194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 477/972] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:19.538194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.574068 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 496/973] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:19.665594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d6e2e-90e8-4d8a-b470-47129d50a119 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.678308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:19.706422 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.707059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.707338 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.707608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.716498 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.718033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:19.730195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:19.731329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:19.732500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 478/974] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:19.737379 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.846587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83b912-21c0-435b-bc16-f59e98dab26c None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.848741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.874328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:19.883323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.893695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:19.893695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:19.893695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:19.893695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:19.893695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:19.893695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:19.905810 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 497/975] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:19.911227 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:19.962379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2a432-90a4-4f12-8ca4-23ecef051409 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:19.999193 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:19.999817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.000096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.000364 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.000941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.002504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:20.011456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:20.012443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:20.013295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 479/976] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:20.016732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bd35-4e00-491f-9309-7f9e905b99b7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.018366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.053833 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.054528 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.054806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.055084 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.055427 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.110868 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.124056 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.125518 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.126308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635fca-c351-44ac-a34c-b7042e8d3ca0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.164110 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.165144 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.165427 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.165703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.166997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:20.167309 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.168996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.174036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 480/977] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:20.179596 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.227464 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 498/978] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:00:20.233177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.279867 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.283802 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2da8-fdc6-471c-834c-95621f1888b0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.320804 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595dda-0562-492c-99e4-676587b97731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.321419 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595dda-0562-492c-99e4-676587b97731 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.321699 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595dda-0562-492c-99e4-676587b97731 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.321997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595dda-0562-492c-99e4-676587b97731 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.322635 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54595dda-0562-492c-99e4-676587b97731 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:20.322949 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54595dda-0562-492c-99e4-676587b97731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.324304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54595dda-0562-492c-99e4-676587b97731 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.326790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.331859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 481/979] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:20.337774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595dda-0562-492c-99e4-676587b97731 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.341720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525492-3456-4230-a925-164c4a6bea80 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.379137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.379688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.379969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.380242 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.391338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.392774 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:20.407404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:20.408402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:20.409847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:20.409847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:20.409847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:20.409847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 499/980] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:20.414527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.450552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595dda-0562-492c-99e4-676587b97731 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.487001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.487613 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.487889 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.488158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.488857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] RBAC: Adding query filter params (interface=admin, service_id=c71456396fff47e1a251c77e583b8cb7, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:20.489162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.490571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.497969 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 482/981] 10.222.0.40 () {56 vars in 1249 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/endpoints?service_id=c71456396fff47e1a251c77e583b8cb7&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:20.501968 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.528976 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.535086 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170c801-8f52-440a-8931-7ad8b98d1750 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.573971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.575434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.575715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.575986 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.576635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:20.576936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.578316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.588269 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.600906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 500/982] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:20.602491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.604737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fea3d-200c-4066-974e-eaedfe21b5c0 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.640252 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789c7a-c472-43a6-ba8b-a7e42d505629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.641270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789c7a-c472-43a6-ba8b-a7e42d505629 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.641270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789c7a-c472-43a6-ba8b-a7e42d505629 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.641270 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789c7a-c472-43a6-ba8b-a7e42d505629 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.641883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789c7a-c472-43a6-ba8b-a7e42d505629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.643259 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789c7a-c472-43a6-ba8b-a7e42d505629 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.656688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 483/983] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:00:20.668230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f300ce-2b79-421e-9cb3-9ef066b8846e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.668905 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f300ce-2b79-421e-9cb3-9ef066b8846e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.669183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f300ce-2b79-421e-9cb3-9ef066b8846e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.671059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 484/984] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:20.676460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.676742 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.677015 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.696229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:20.697801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:20.720451 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935e328-3909-4595-8432-e15ad55b1030 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.759948 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.760605 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.760999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.761272 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.769050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.769488 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 485/985] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:20.771395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:20.784173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:20.785105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:20.786058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 501/986] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:20.792322 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:20.814390 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:20.895037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01397fa-ad4c-4190-922f-f5033aff1892 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:20.929871 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:20.930506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:20.930786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:20.931057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:20.931749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:20.932051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:20.933472 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:20.949964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 486/987] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:20.951728 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:21.013529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:21.037024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:21.058673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166824-3b56-4cdc-8412-f6dd599df756 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:21.095316 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:21.095997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:21.096261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:21.096448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:21.097162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] RBAC: Adding query filter params (role.id=050e5bd9ca5147bb8e4f67bcd351c367, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2d9c65025dcd4c5ab7b61a9daeb0945c) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:21.097576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:21.099149 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118ef78-1a26-4bc0-aea2-12ced9f62392 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:21.105972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 502/988] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:20 2022] GET /identity/v3/role_assignments?user.id=2d9c65025dcd4c5ab7b61a9daeb0945c&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=050e5bd9ca5147bb8e4f67bcd351c367 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:21.140480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:21.162172 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008b57-e174-4484-97a8-a4608ba2c8bc None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:21.201037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77024a-5c44-4fd4-aadd-6c8ad715fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:21.201664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77024a-5c44-4fd4-aadd-6c8ad715fa60 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:21.201961 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77024a-5c44-4fd4-aadd-6c8ad715fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:21.202241 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77024a-5c44-4fd4-aadd-6c8ad715fa60 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:21.202982 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77024a-5c44-4fd4-aadd-6c8ad715fa60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:21.204366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77024a-5c44-4fd4-aadd-6c8ad715fa60 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:21.280638 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 487/989] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:21 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:22.594946 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f0882-0080-4640-96d5-9045a0775f12 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:22.595480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f0882-0080-4640-96d5-9045a0775f12 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:22.595480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f0882-0080-4640-96d5-9045a0775f12 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:22.596991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 503/990] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:22.602096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d97d7-133b-4442-a658-acb812a2cf3e None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:22.602475 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d97d7-133b-4442-a658-acb812a2cf3e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:22.602642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d97d7-133b-4442-a658-acb812a2cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:22.621056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-ea4d97d7-133b-4442-a658-acb812a2cf3e None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:22.622280 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-ea4d97d7-133b-4442-a658-acb812a2cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:22.696838 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 488/991] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:22.964997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f0882-0080-4640-96d5-9045a0775f12 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.048490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a2e16-fc5d-47b2-888d-bc87150de3eb None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.048780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a2e16-fc5d-47b2-888d-bc87150de3eb None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.049053 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a2e16-fc5d-47b2-888d-bc87150de3eb None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.050553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 489/992] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:23.056192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ea4a-ab98-4be0-958d-ecfe799a9c2b None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.056471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ea4a-ab98-4be0-958d-ecfe799a9c2b None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.056743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ea4a-ab98-4be0-958d-ecfe799a9c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.071410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f0882-0080-4640-96d5-9045a0775f12 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.076944 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f8a4ea4a-ab98-4be0-958d-ecfe799a9c2b None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:23.078136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f8a4ea4a-ab98-4be0-958d-ecfe799a9c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:23.094228 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.105564 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.112917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.112917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.112917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.112917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.112917 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:23.117658 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:23.118775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:00:23.119613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:23.123789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 504/993] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Aug 12 11:00:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:23.125081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.148628 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.156605 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 490/994] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:23.211818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdf37-0219-4530-90bf-0ce18bf056a3 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.212102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdf37-0219-4530-90bf-0ce18bf056a3 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.212412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdf37-0219-4530-90bf-0ce18bf056a3 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.213864 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 491/995] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:23.218565 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.218792 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.219065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.230502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c4de-4e6e-4c29-a4df-3abc3bcd183c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.237487 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:23.238844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:23.266498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.267099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.267380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.267651 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.268281 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:23.268583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.269945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.275267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 505/996] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:23.281187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.319442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 492/997] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:23.334937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.384435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced1ce-9642-4152-a22d-59f6a40dc7a9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.418093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.418697 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.418973 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.419239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.419861 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:23.420160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.421516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.421861 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.431041 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 506/998] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:23.432444 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.526211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9aaa-a59f-4b80-b820-d764244263ce None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.538457 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b285f3-ff2d-4009-9ce4-4d8efb7957bd None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.554802 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.554972 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.564526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.565156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.567108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.567108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] PATH_INFO: `/v3/services/image` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.567108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.567718 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.575863 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.576463 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.576746 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:23.576987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:23.577986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:23.582990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:23.583724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.583724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.583850 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 493/999] 10.222.0.40 () {56 vars in 1105 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:23.583916 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.585981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.649949 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 507/1000] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:23.649949 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.695583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec1cd3-98a5-4f83-92cd-b9a490f37e9e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.742606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.743223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.743523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.743772 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.744408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:23.744701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.745852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c2d0-0c9c-4bc9-b19b-9a5b1be9825d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.746112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.757184 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 494/1001] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:23.758307 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.784132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.784687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.784962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.785227 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] PATH_INFO: `/v3/services/compute` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.785809 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.787191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:23.797378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:23.798413 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:23.799308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 508/1002] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:23.805300 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:23.818495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.849299 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:23.871348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607d845-bf91-4c50-9ddd-30a05369ccb1 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.907203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.907813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.908092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.908362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.908994 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] RBAC: Adding query filter params (type=image) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:23.909299 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.910709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.916371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 495/1003] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:23.920679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b7cff-1309-446a-b7f5-554c28edddee None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:23.957441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:23.958088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:23.958373 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:23.958648 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:23.959820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:23.960129 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:23.961641 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:23.971869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 509/1004] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:23.973803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:24.081880 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e8ac-4596-47c2-b0b8-57a5dc9cba9b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:24.096420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:24.116670 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:24.117279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:24.117558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:24.117829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:24.118495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:24.118797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:24.120158 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:24.125213 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 496/1005] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:24.131872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:24.237371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b603e-a2eb-48ab-b686-a9c8ac047f07 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:24.239073 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:24.272595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:24.273276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:24.273563 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:24.273838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:24.274577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] RBAC: Adding query filter params (interface=public, service_id=8fff64c609804ae48727c402029269da, region_id=RegionOne) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:24.274890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:24.276262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ca073-eb2f-4152-91a6-3a3f6a008e16 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:24.286014 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 510/1006] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 11:00:24 2022] GET /identity/v3/endpoints?service_id=8fff64c609804ae48727c402029269da&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:24.287194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:24.391625 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f5cc5-dca6-4512-a341-12874e28f02e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:24.425995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b10715-9cd0-40f4-a110-aa70e8281f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:24.426605 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b10715-9cd0-40f4-a110-aa70e8281f6d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:24.426885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b10715-9cd0-40f4-a110-aa70e8281f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:24.427156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b10715-9cd0-40f4-a110-aa70e8281f6d None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:24.427756 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b10715-9cd0-40f4-a110-aa70e8281f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:24.429713 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b10715-9cd0-40f4-a110-aa70e8281f6d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:24.446210 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 497/1007] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:00:24 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:00:25.590556 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7c16-39d1-4d18-a3dd-ef653f1bdfd6 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:25.591062 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7c16-39d1-4d18-a3dd-ef653f1bdfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:25.591139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7c16-39d1-4d18-a3dd-ef653f1bdfd6 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:25.593974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 511/1008] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:25.597683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec9be0-ef6e-4e82-ae15-adee4fd23970 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:25.598099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec9be0-ef6e-4e82-ae15-adee4fd23970 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:25.598262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec9be0-ef6e-4e82-ae15-adee4fd23970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:25.617214 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f6ec9be0-ef6e-4e82-ae15-adee4fd23970 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:25.618475 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f6ec9be0-ef6e-4e82-ae15-adee4fd23970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:25.655767 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:25.687762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 498/1009] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:25.834446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87181b5-4332-4724-b928-3cbd576052c7 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:25.834764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87181b5-4332-4724-b928-3cbd576052c7 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:25.834994 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87181b5-4332-4724-b928-3cbd576052c7 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:25.836472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 512/1010] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:25.841392 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:25.841683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:25.841975 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:25.861008 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:25.862230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:25.931019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 499/1011] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:25.959605 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87181b5-4332-4724-b928-3cbd576052c7 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:26.060035 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87181b5-4332-4724-b928-3cbd576052c7 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:26.093258 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:26.093874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:26.094179 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:26.094446 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:26.095546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:26.096955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:26.098687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 513/1012] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:26.104411 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:26.196924 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:26.206424 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf6643-4ea5-4646-bd37-1ec8d8d51c2f None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:26.206424 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:26.236842 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:26.241734 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ca200-a257-4e4a-a103-c7eaec374f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:26.242431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ca200-a257-4e4a-a103-c7eaec374f98 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:26.242712 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ca200-a257-4e4a-a103-c7eaec374f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:26.243223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ca200-a257-4e4a-a103-c7eaec374f98 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:26.243829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ca200-a257-4e4a-a103-c7eaec374f98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:26.245816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ca200-a257-4e4a-a103-c7eaec374f98 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:26.310384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade858-8dc9-48e8-8232-1e0aea8feb65 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:26.326745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 500/1013] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:26 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:26.354536 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:26.355176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:26.355454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:26.355732 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:26.356377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:26.357841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:26.384955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b67bb-ebaf-411b-8c5a-cbd40c76aa97 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:26.385266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b67bb-ebaf-411b-8c5a-cbd40c76aa97 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:26.385541 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b67bb-ebaf-411b-8c5a-cbd40c76aa97 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:26.387034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 501/1014] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:26.392731 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:26.394294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:26.394294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:26.413153 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:26.414407 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:26.447200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 514/1015] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:26 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:26.508808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 502/1016] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:26 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:26.775707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:26.872822 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:26.880323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f16b9-a479-4a7d-983a-dbe33f4e3029 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:26.915581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:26.916471 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:26.916751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:26.917020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:26.917608 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:26.919057 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:26.928271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:26.929530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:00:26.930414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:26.934023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 515/1017] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:26.935604 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:27.018531 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:27.038506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e202-c294-470e-aac0-bb490d97af69 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:27.072884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:27.073496 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:27.073780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:27.074085 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:27.074724 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:27.075029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:27.076395 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:27.086620 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 503/1018] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:27.087819 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:27.190890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81dbf1-e3ed-40a9-98b6-492ee7748fea None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:27.224692 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:27.225480 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:27.225805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:27.226111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:27.226735 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:27.227041 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:27.228407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe67e2-0a41-4ec6-9bec-bb2af9ac6597 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:27.233768 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 516/1019] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Aug 12 11:00:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:27.239360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:27.340482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c435c-02a0-425b-9dbb-48c64917b83f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:27.376737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a24db-4b6a-429d-a689-8df8e7c01326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:27.377782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a24db-4b6a-429d-a689-8df8e7c01326 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:27.378311 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a24db-4b6a-429d-a689-8df8e7c01326 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:27.378794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a24db-4b6a-429d-a689-8df8e7c01326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:27.379669 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a24db-4b6a-429d-a689-8df8e7c01326 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:27.381382 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a24db-4b6a-429d-a689-8df8e7c01326 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:27.470057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:27.482045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 504/1020] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:28.307764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f0c-7b37-489e-8ed6-225e9d586bb9 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.308307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f0c-7b37-489e-8ed6-225e9d586bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.308307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f0c-7b37-489e-8ed6-225e9d586bb9 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.309798 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 517/1021] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:28.315071 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.315448 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.315624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.333480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:28.335305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:28.360704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5759c-9d11-4d48-9cfc-258448b1efab None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.360990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5759c-9d11-4d48-9cfc-258448b1efab None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.361261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5759c-9d11-4d48-9cfc-258448b1efab None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.362743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 518/1022] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:28.367939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.368219 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.368489 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.387306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:28.388486 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:28.405490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:28.412877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 505/1023] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:28.465958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 519/1024] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:28.677491 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:28.729607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:28.780547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948f01-2ccc-4fa2-91ec-6c339a36c48a None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:28.807866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:28.817457 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:28.818131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.818451 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.818725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.819852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:28.821281 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:28.822893 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 506/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:28.828660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:28.843019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ededb-e26c-4492-9e21-76f71196288a None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:28.882131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:28.882771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.883131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.883409 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.883999 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:28.885470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:28.894348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:28.900484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:28.901554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 520/1026] 10.222.0.40 () {56 vars in 1105 bytes} [Fri Aug 12 11:00:28 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:28.903832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:28.924189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:28.942240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79456-8741-4785-9fb1-a8101087f9dd None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:28.980877 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:28.981492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:28.981817 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:28.982114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:28.982740 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:28.984749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:29.014666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05558bc2-2a50-4657-b94d-47f2ae0189a8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:29.050243 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:29.050850 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:29.051127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:29.051397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:29.052026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] RBAC: Adding query filter params (name=image) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:29.052328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:29.054052 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:29.058919 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 521/1027] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:29.064619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:29.109437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 507/1028] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 11:00:28 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:00:29.164627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:29.187264 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a478-0b0f-4819-860c-46129102e46c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:29.225395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:29.225970 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:29.226229 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:29.226500 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:29.227201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] RBAC: Adding query filter params (type=image) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:29.227578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:29.229034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:29.239222 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 522/1029] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:29.240745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:29.294802 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:29.350918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d7a2b-241e-45aa-b1aa-88cf308c8b0c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:29.387170 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:29.388028 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:29.388455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:29.388870 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:29.389723 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] RBAC: Adding query filter params (interface=public, service_id=375a6dc9719c47edb72315ad949c7ce1, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:29.390236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:29.391737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8b294-4873-49f1-818f-3229571b485d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:29.397886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 508/1030] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 11:00:29 2022] GET /identity/v3/endpoints?service_id=375a6dc9719c47edb72315ad949c7ce1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:29.403515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:29.498368 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631b67-83ce-40e6-9e55-87c0c28c1a05 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:29.498559 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631b67-83ce-40e6-9e55-87c0c28c1a05 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:29.498820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631b67-83ce-40e6-9e55-87c0c28c1a05 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:29.500292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 509/1031] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:29.505017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:29.505297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:29.505567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:29.515433 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4715-fda0-483d-b1d4-906debf2720d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:29.525320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:29.526634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:29.559030 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:29.559644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:29.559925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:29.560198 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:29.560803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:29.562191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:29.569699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 523/1032] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:00:29 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:00:29.609449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 510/1033] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:29.886679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:29.899315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:29.986794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857030-c184-476d-92ba-53e42bb7caca None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:30.025681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:30.026351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:30.026635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:30.026910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:30.038105 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:30.042983 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:30.043869 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:30.044731 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:30.046272 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 524/1034] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Aug 12 11:00:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:30.050057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:30.098294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:30.153227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b58378-935d-4641-b11f-f3c9b0feef06 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:30.188414 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:30.189032 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:30.189308 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:30.189577 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:30.190261 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:30.190566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:30.191924 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:30.204660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 511/1035] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:00:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:30.205906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:30.275289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:30.311078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf9dd-3a4e-44de-bfe1-52e04922f9ec None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:30.344134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:30.344814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:30.345103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:30.345372 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:30.356384 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:30.357813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:30.371662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:30.372650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:30.373527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:30.373527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:30.373527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:30.373527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 525/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:30.378904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:30.486222 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607053c6-fd62-440c-9383-b07a3135eee8 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:30.494289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:30.520282 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14843718-a223-4660-8548-28ae83b26429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:30.520900 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14843718-a223-4660-8548-28ae83b26429 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:30.521175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14843718-a223-4660-8548-28ae83b26429 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:30.521473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14843718-a223-4660-8548-28ae83b26429 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:30.522161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14843718-a223-4660-8548-28ae83b26429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:30.522463 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14843718-a223-4660-8548-28ae83b26429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:30.523834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14843718-a223-4660-8548-28ae83b26429 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:30.540978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 512/1037] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:30.542689 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:30.642235 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca58347-6499-4355-a3f6-a71d9ae5e09c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:30.663659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:30.678521 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:30.679274 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:30.679652 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:30.680015 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:30.687592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:30.689117 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:30.701290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:30.702514 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:30.703718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:30.710588 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 526/1038] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 11:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:30.711638 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14843718-a223-4660-8548-28ae83b26429 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:30.810645 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14843718-a223-4660-8548-28ae83b26429 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:30.844254 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:30.844971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:30.845349 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:30.845716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:30.846578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:30.846997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:30.848500 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548c4d4-b1cf-413e-8987-90867790f08a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:30.873231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 513/1039] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 11:00:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:30.874490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:30.975629 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ab946-4f7d-4995-aeca-4d80297a4325 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.010306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.010915 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.011195 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.011467 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.059832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.079834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.081285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.120331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0a028-7dee-4231-add3-5417b927c5e1 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.120653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0a028-7dee-4231-add3-5417b927c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.120895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0a028-7dee-4231-add3-5417b927c5e1 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.122277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 514/1040] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:31.127249 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412524-4e5b-4fb4-8751-26641980feca None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.127532 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412524-4e5b-4fb4-8751-26641980feca None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.127806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412524-4e5b-4fb4-8751-26641980feca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.147553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-61412524-4e5b-4fb4-8751-26641980feca None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:31.148980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-61412524-4e5b-4fb4-8751-26641980feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:31.168090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.188602 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 527/1041] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:00:31.194615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.227031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 515/1042] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:31.279346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.298436 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2f9cd-547d-4f78-a475-ab98a9eb5cee None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.332934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.333554 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.333880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.334189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.344106 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.345540 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-e6c3cfeb-3099-435a-9476-099718e1c1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:31.359932 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:31.360880 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:31.361791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:31.361791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:31.361791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:31.362636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 528/1043] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:31.367449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412524-4e5b-4fb4-8751-26641980feca None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.477219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412524-4e5b-4fb4-8751-26641980feca None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.493546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754eb64-6156-40fc-882a-e7c1adfc22a3 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.493860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754eb64-6156-40fc-882a-e7c1adfc22a3 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.494131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754eb64-6156-40fc-882a-e7c1adfc22a3 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.495629 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 529/1044] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:00:31.496607 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754eb64-6156-40fc-882a-e7c1adfc22a3 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.512623 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.513228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.513509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.513780 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.514460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:31.514771 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.516133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b8371-72af-40c1-8d31-45eab83d643c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.527745 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 516/1045] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:31.528903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.529185 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.529453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.548332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:31.549510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:31.558760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.603265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754eb64-6156-40fc-882a-e7c1adfc22a3 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.615434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 517/1046] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:31.616331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.635818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.641325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.642178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.642541 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.642934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.654748 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:31.659959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:31.661010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:31.662156 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:31.669724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 530/1047] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:31.670874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.721459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9566-973f-4b8d-93ce-703f065b4d56 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.758030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.758662 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.758941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.759212 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.766167 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.767601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.773205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe0632-0c2f-4e85-854b-d5ddab36f696 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:31.779124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:31.780114 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:31.781002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:31.785128 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 518/1048] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:31.785979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.791315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.811453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.812053 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.812327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.812593 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.813283 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:31.813617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.814980 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.823784 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 531/1049] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:31.829695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.890388 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:31.893090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117ffb6-a7c0-4b5e-bc70-c94372b17ef3 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.926741 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.927345 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.928327 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.928604 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.929290 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:31.929595 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.931060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.935627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d96826-11a4-43e0-9873-484377f82aca None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:31.943647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 519/1050] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:31.944579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:31.969337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:31.969991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:31.970278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:31.970556 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] PATH_INFO: `/v3/users/5e0f8a257a3f4a15a1d4812b09c186c3` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:31.983560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] RBAC: Authorizing `identity:get_user(user_id=5e0f8a257a3f4a15a1d4812b09c186c3)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:31.984988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:31.991925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 532/1051] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/users/5e0f8a257a3f4a15a1d4812b09c186c3 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:31.991925 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.005288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.043043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb712de-8ef8-41c5-b63d-6aba4f927d8d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.076045 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.076680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.076958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.077235 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] PATH_INFO: `/v3/services/image` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.077811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.079197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.086959 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709697-bc35-48a5-b491-eb74a33974fe None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:32.089262 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:32.090459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:32.091289 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 520/1052] 10.222.0.40 () {56 vars in 1105 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:32.092187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.100929 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.121407 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.122035 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.122318 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.122589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.123403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] RBAC: Adding query filter params (role.id=050e5bd9ca5147bb8e4f67bcd351c367, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=eb9bed06ddf345e7aa00bde7a8ad770b) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:32.123707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.125118 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.130506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 533/1053] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:31 2022] GET /identity/v3/role_assignments?user.id=eb9bed06ddf345e7aa00bde7a8ad770b&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=050e5bd9ca5147bb8e4f67bcd351c367 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:32.132084 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.207224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75306b-28e1-4ee7-bb95-c23853b43d85 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.240550 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.249010 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.249630 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.249909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.250513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.253633 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780afba1-6462-4fd5-ac80-617547123e21 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.302352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.303415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.303691 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.303965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.304659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:32.304962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.306352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.311531 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 534/1054] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:32.317177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.326279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.327814 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.363137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.423378 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2e8d-26cc-41f0-951c-886f8a9115e7 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.444017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 521/1055] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:32.447257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.471264 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.472023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.472309 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.472578 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.473202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] RBAC: Adding query filter params (type=image) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:32.473502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.475622 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.478356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.485100 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 535/1056] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:32.486815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.560988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a53e5e-c660-45bd-898d-71929864981c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.594085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb5be-c896-4ffd-93c1-236899462edc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.596016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.596658 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.596938 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.597212 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.597436 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.598472 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] RBAC: Authorizing `identity:get_project(project_id=fd1655aca4944477b8a887cf8e105fe4)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.600513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.607148 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 522/1057] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:32 2022] GET /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:32.609303 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:32.635098 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb9317-55b6-4f6e-a352-3a44a72376e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.635710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9317-55b6-4f6e-a352-3a44a72376e9 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.635991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9317-55b6-4f6e-a352-3a44a72376e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.636263 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9317-55b6-4f6e-a352-3a44a72376e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.636922 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb9317-55b6-4f6e-a352-3a44a72376e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.638317 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb9317-55b6-4f6e-a352-3a44a72376e9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.707526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:32.714075 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1ded-1430-4b60-886b-41de6dd68d1a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:32.742545 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 536/1058] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:00:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:32.761029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:32.761654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:32.761948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:32.762234 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:32.762983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=fd1655aca4944477b8a887cf8e105fe4, user.id=5e0f8a257a3f4a15a1d4812b09c186c3) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:32.768831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:32.768831 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4458a52-6917-48d4-9c5c-b3a79765b75f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:32.773207 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 523/1059] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:32 2022] GET /identity/v3/role_assignments?user.id=5e0f8a257a3f4a15a1d4812b09c186c3&scope.project.id=fd1655aca4944477b8a887cf8e105fe4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:34.014569 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2c11-10f8-4aff-8050-ab2335d6a758 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.015127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2c11-10f8-4aff-8050-ab2335d6a758 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.015127 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2c11-10f8-4aff-8050-ab2335d6a758 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.016478 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 537/1060] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:34.021427 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.021873 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.022143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.040657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:34.042125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:34.111930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 524/1061] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:34.379397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2c11-10f8-4aff-8050-ab2335d6a758 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:34.492715 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2c11-10f8-4aff-8050-ab2335d6a758 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:34.526523 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:34.527145 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.527426 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.527698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.538164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:34.543004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:34.543893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:34.544884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 538/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Aug 12 11:00:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:34.550047 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:34.634106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:34.649204 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5629c-cc45-4af8-8c6e-da50552179b8 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:34.683863 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:34.684473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.684750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.685018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.685680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:34.686006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:34.687518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97531a0-8533-418a-9913-43fbd958cc81 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:34.700723 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 525/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:00:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:34.702422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:34.716798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580106-51b1-4831-8fa4-ad252da09540 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.717116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580106-51b1-4831-8fa4-ad252da09540 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.717389 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580106-51b1-4831-8fa4-ad252da09540 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.718866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 526/1064] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:34.723532 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd7590-948e-4620-a429-bd966d0e91d7 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.723815 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd7590-948e-4620-a429-bd966d0e91d7 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.724090 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd7590-948e-4620-a429-bd966d0e91d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.726780 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:34.742292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-cfdd7590-948e-4620-a429-bd966d0e91d7 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:34.743480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-cfdd7590-948e-4620-a429-bd966d0e91d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:34.804785 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0c5e-cc0d-47b1-8bfd-88cc6cad0f3f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:34.810761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 527/1065] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:34.814146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88d36-ec9c-4fe1-bf13-6a0ac598b752 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.814146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88d36-ec9c-4fe1-bf13-6a0ac598b752 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.814146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88d36-ec9c-4fe1-bf13-6a0ac598b752 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.814146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 528/1066] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:34.819856 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.820138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.820406 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.838226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:34.839396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:34.844406 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:34.845032 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:34.845307 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:34.845575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:34.856077 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:34.857503 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:34.871107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:34.872119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:34.873033 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:34.873033 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:34.873033 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:34.873033 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 539/1067] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:34.878090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:34.914473 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 529/1068] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:34.951775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:34.981007 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d8a0-1046-4f23-92dc-42e4a27d47c0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.014632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.015315 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.015645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.015981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.016679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:35.017046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.018491 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.035981 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 540/1069] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:35.037782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.048521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.082113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.138836 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff32af-15a3-4b6f-965b-d1591c1245c2 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.177762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.178664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.179040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.179412 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.187251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.188455 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385930-7fec-4095-8831-7e8c2b2307aa None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.188799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:35.200175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:35.201319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 530/1070] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:35.202492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.221264 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.227287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.227888 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.228169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.234257 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.269259 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.296803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.298275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.303991 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c89f9-01a9-4f31-a64c-aed8526de0d5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.336982 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.337609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.337890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.338197 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.348187 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:35.354033 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:35.355088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 531/1071] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:35.355986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.399423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 541/1072] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:00:35.400569 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.431076 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.457272 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955cecb-9425-4f92-aa20-d908ab7f7b55 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.484052 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.491818 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.497504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.497504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.497504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.497504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:35.497504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.497504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.500623 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523118-f186-41da-8f66-443f7f2c05cf None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.513610 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 532/1073] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:35.514452 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.534884 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.535482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.535762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.536031 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.536681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:35.537005 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.538408 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.546430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 542/1074] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:35.547196 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.611733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ceae7-2b0a-4ec3-a761-63758328feea None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.640834 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.645216 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.645934 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.646840 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.647109 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.647801 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7392-1c40-40cf-8cce-4a737399d670 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.657194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.658657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:35.673268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:35.674211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:35.680315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:35.680315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:35.680315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:35.680315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 533/1075] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:35.680315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.682659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.683234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.683515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.683786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.694858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.696292 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:35.710460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:35.711646 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:35.712529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:35.712529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:35.712529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:35.712529 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 543/1076] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:35.712762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.718872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.776734 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecbe94-fa40-44de-8db1-71d35bb38040 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.810391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.811018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.811301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.811576 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] PATH_INFO: `/v3/users/5e0f8a257a3f4a15a1d4812b09c186c3` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.812716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=5e0f8a257a3f4a15a1d4812b09c186c3)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.813265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31e7de-ebf9-487f-85e9-411a72697f32 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.814182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.815782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 534/1077] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/users/5e0f8a257a3f4a15a1d4812b09c186c3 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:35.816551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.847313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.847909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.848185 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.848455 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.849088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:35.850169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.851617 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.862785 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 544/1078] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:35.863625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.887714 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.926838 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadbea9-8d02-4be4-83dd-8b27cf1f5fc2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:35.936709 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:35.968707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:35.969738 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:35.970237 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:35.970719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:35.971596 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:35.972099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:35.973696 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:35.986776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 535/1079] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:35.993402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:35.996766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30095d2-9c2e-47f9-b523-19749b3165bc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:36.040124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:36.040752 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:36.041287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:36.041570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:36.042740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] RBAC: Authorizing `identity:get_project(project_id=fd1655aca4944477b8a887cf8e105fe4)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:36.044191 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:36.053088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 545/1080] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:36.053088 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:36.111521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3725ac-c9eb-4615-90b5-31e6c4697910 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:36.137942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:36.154908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:36.166879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:36.166879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:36.166879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:36.166879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:36.166879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:36.167287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e6070-fd8e-475f-a864-1594a7e319aa None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:36.176147 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:36.177034 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:36.178099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 536/1081] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:36.183174 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:36.200927 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:36.201506 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:36.201782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:36.202082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4/users/5e0f8a257a3f4a15a1d4812b09c186c3/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:36.203977 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] RBAC: Authorizing `identity:create_grant(project_id=fd1655aca4944477b8a887cf8e105fe4, user_id=5e0f8a257a3f4a15a1d4812b09c186c3, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:36.205397 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:36.212585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:36.267024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 546/1082] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:00:36 2022] PUT /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4/users/5e0f8a257a3f4a15a1d4812b09c186c3/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:00:36.283952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b055c-f165-4b39-9f6a-fc6b5721633b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:36.323216 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:36.323843 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:36.324124 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:36.324396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:36.325102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:36.325408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:36.326883 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f274-f024-421d-a5dc-52f030e33246 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:36.344668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 537/1083] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:36.346024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:36.452107 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9fc5-8b8c-44cf-ab62-55599898c16b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:36.486442 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed07357-987f-4f84-9065-9a16c155942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:36.487096 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed07357-987f-4f84-9065-9a16c155942b None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:36.487376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed07357-987f-4f84-9065-9a16c155942b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:36.487645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed07357-987f-4f84-9065-9a16c155942b None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/eb9bed06ddf345e7aa00bde7a8ad770b/roles/050e5bd9ca5147bb8e4f67bcd351c367` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:36.489762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed07357-987f-4f84-9065-9a16c155942b None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=eb9bed06ddf345e7aa00bde7a8ad770b, role_id=050e5bd9ca5147bb8e4f67bcd351c367)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:36.491215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed07357-987f-4f84-9065-9a16c155942b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:36.493381 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:36.541814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 547/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:00:36 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/eb9bed06ddf345e7aa00bde7a8ad770b/roles/050e5bd9ca5147bb8e4f67bcd351c367 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:00:38.155918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2556-ebeb-470e-ae44-26c7bebcc778 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.156460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2556-ebeb-470e-ae44-26c7bebcc778 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.156460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2556-ebeb-470e-ae44-26c7bebcc778 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.157840 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 538/1085] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:38.167099 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741b66-e398-446d-af3a-4c1174697980 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.167533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741b66-e398-446d-af3a-4c1174697980 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.167621 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741b66-e398-446d-af3a-4c1174697980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.185335 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-58741b66-e398-446d-af3a-4c1174697980 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:38.186539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-58741b66-e398-446d-af3a-4c1174697980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:38.252173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 548/1086] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:38.412079 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2aac0c-62a1-40a6-8ab5-ef13c331a3fc None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.412424 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2aac0c-62a1-40a6-8ab5-ef13c331a3fc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.412704 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2aac0c-62a1-40a6-8ab5-ef13c331a3fc None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.414064 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 539/1087] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:38.419460 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.419749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.420023 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.438510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:38.439687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:38.504963 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 549/1088] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:00:38.522495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2aac0c-62a1-40a6-8ab5-ef13c331a3fc None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:38.606416 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:38.621515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2aac0c-62a1-40a6-8ab5-ef13c331a3fc None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:38.655334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:38.655956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.656236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.656505 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.666693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:38.671243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:38.672149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:38.673186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 540/1089] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:38.678449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:38.731041 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:38.774368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55efa-925f-476c-a4f0-0fc74d89f75a None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:38.774614 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:38.809314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:38.809936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.810240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.810502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.811165 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:38.811470 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:38.812828 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:38.821024 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 550/1090] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:38.826694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:38.874568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbee383-3190-4545-8a13-336300a1f5ff None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:38.907067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:38.907684 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.907959 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.908228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.919167 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:38.923676 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:38.924761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:00:38.925608 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:38.926279 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f4a36-15f5-46ac-b69c-d034d02a0737 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:38.926354 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 541/1091] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Aug 12 11:00:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:38.931186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:38.939777 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:38.941448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:38.959306 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:38.959936 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:38.960220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:38.960492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] PATH_INFO: `/v3/users/5e0f8a257a3f4a15a1d4812b09c186c3` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:38.961634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] RBAC: Authorizing `identity:get_user(user_id=5e0f8a257a3f4a15a1d4812b09c186c3)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:38.963170 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:38.964808 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 551/1092] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:38 2022] GET /identity/v3/users/5e0f8a257a3f4a15a1d4812b09c186c3 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:38.970664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.030512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6c95-6b29-4707-b25e-b35d357c9c93 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.064017 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.064617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.064901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.065172 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.065832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:39.066160 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.067526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.071742 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ed5eb-79fb-4f73-a365-749f443f0b06 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.076175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 542/1093] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:00:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:39.081902 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.105276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.105890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.106195 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.106469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.145459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:39.156516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:39.172672 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.174121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.179442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67396b7-726e-4351-be16-569dff618ba2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.212906 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.213528 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.213810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.214118 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.224988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.226461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:39.240716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:39.242512 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:39.243691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:39.243691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:39.243691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:39.243691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 543/1094] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:00:39.247725 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.275745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 552/1095] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:00:39.276752 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.345866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2427f-98b0-43c0-8309-71e07f9426c4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.361228 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:39.366136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:39.376492 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051875a-ee83-4545-9ec3-a05fecc04e13 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.379429 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.380025 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.380303 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.380573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.381215 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:39.381517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.382914 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.394288 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 544/1096] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:39.400194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.409911 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.410560 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.410838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.411111 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.413058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1655aca4944477b8a887cf8e105fe4)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.414539 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.416438 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 553/1097] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:39.422520 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.503916 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560cc33-d440-4113-a1f5-103f425cc451 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.521775 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8562a-fcb0-43f0-a30d-6ccb185e1b30 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.538343 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.538972 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.539251 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.539524 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.547065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.548495 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.555636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.556234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.556512 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.556784 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.557500 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=fd1655aca4944477b8a887cf8e105fe4, user.id=5e0f8a257a3f4a15a1d4812b09c186c3) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:39.557812 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.559268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:00:39.560266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:39.561217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:39.562217 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 545/1098] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:39.565469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 554/1099] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/role_assignments?user.id=5e0f8a257a3f4a15a1d4812b09c186c3&scope.project.id=fd1655aca4944477b8a887cf8e105fe4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:39.567029 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.614263 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:39.674332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a361-6d2b-4472-adcb-969a7a51d180 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.709810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.710425 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.710705 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.710997 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.711719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:39.712027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.713435 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.730785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 546/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:39.736612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:39.756786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:39.835856 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a5d3-988e-4844-b3a8-207eb835e656 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:39.869095 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:39.869694 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:39.870003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:39.870276 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:39.935542 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:39.936985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:39.954063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:40.048048 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 555/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:40.054606 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:40.148335 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:40.153663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c09da-ff1e-49d4-8b78-81bbff4612bf None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:40.188420 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:40.189031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:40.189310 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:40.189582 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:40.199619 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:40.201060 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:00:40.215747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:40.216743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:00:40.217607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:00:40.217607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:00:40.217607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:40.217607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 547/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:40.222793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:40.320524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28463066-922a-45e4-91f1-10bf44e896bd None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:40.336826 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:40.353618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:40.354245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:40.354527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:40.354796 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:40.355431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:40.355729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:40.357070 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:40.373058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 556/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:40.374439 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:40.474646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c999-d931-4e1d-a63f-5a3c0f311b75 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:40.507691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:40.508312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:40.508586 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:40.508855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:40.515277 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:40.516707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:00:40.527690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:40.528707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:00:40.529995 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 548/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:40.534613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:40.634131 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692a6f5-e40d-4405-bb53-d7db51037a41 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:40.669233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:40.669844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:40.670155 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:40.670428 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:40.671122 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:40.671427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:40.672853 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855cbc-af08-4319-8c6e-f71f445efbe2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:40.685080 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 557/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:40.691150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:40.704408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:40.790551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af67eac-4a8a-4273-9001-2f63c7789b44 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:40.823601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:40.824194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:40.824472 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:40.824744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:40.825456 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] RBAC: Adding query filter params (role.id=050e5bd9ca5147bb8e4f67bcd351c367, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=eb9bed06ddf345e7aa00bde7a8ad770b) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:40.825763 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:40.827199 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0106b-1303-4207-a43d-fbf907852a08 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:40.832735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 549/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:40 2022] GET /identity/v3/role_assignments?user.id=eb9bed06ddf345e7aa00bde7a8ad770b&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=050e5bd9ca5147bb8e4f67bcd351c367 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:41.493635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e756-a882-4689-bfd1-6ba2c280b19a None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:41.494201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e756-a882-4689-bfd1-6ba2c280b19a None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:41.494317 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e756-a882-4689-bfd1-6ba2c280b19a None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:41.495596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 558/1107] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:41.501139 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:41.501542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:41.501674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:41.520356 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:41.522346 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:41.590794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 550/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:41.859082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e756-a882-4689-bfd1-6ba2c280b19a None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:41.894659 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:41.956761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e756-a882-4689-bfd1-6ba2c280b19a None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:41.988202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec581fb-288d-40b4-9cef-92a7b45e1ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:41.988806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec581fb-288d-40b4-9cef-92a7b45e1ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:41.989083 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec581fb-288d-40b4-9cef-92a7b45e1ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:41.989352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec581fb-288d-40b4-9cef-92a7b45e1ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:41.991256 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec581fb-288d-40b4-9cef-92a7b45e1ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:41.992663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec581fb-288d-40b4-9cef-92a7b45e1ff9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:41.994229 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 559/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:41.999981 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:42.003064 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:42.095054 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c5a2-20d0-4f37-9965-7eac4ee3e7db None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:42.127735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948b889-deb0-40e7-a9c0-dc2020b60b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:42.128267 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948b889-deb0-40e7-a9c0-dc2020b60b9b None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:42.128543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948b889-deb0-40e7-a9c0-dc2020b60b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:42.128812 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948b889-deb0-40e7-a9c0-dc2020b60b9b None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:42.129450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948b889-deb0-40e7-a9c0-dc2020b60b9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:42.130901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948b889-deb0-40e7-a9c0-dc2020b60b9b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:42.203169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 551/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 11:00:41 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:44.163589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d81a-03ba-49b2-badb-e35bd0154917 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:44.164139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d81a-03ba-49b2-badb-e35bd0154917 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:44.164139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d81a-03ba-49b2-badb-e35bd0154917 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:44.165477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 560/1111] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:44.170907 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:44.171332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:44.171460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:44.189591 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:44.190812 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:44.245179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:44.256067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 552/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:44.530220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d81a-03ba-49b2-badb-e35bd0154917 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:44.627586 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d81a-03ba-49b2-badb-e35bd0154917 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:44.629794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:44.659614 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:44.660452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:44.660918 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:44.662047 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] PATH_INFO: `/v3/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:44.663453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] RBAC: Authorizing `identity:get_role(role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:44.665326 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:44.667487 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 561/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:44 2022] GET /identity/v3/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:44.673458 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:44.774506 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee1853-7469-4a54-877a-eabf50854896 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:44.807265 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:44.807884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:44.808161 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:44.808431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] PATH_INFO: `/v3/users/daed56740c7b4610b701ced4adb60d48` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:44.821084 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] RBAC: Authorizing `identity:get_user(user_id=daed56740c7b4610b701ced4adb60d48)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:44.822546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:44.824111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 553/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:44 2022] GET /identity/v3/users/daed56740c7b4610b701ced4adb60d48 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:44.829985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:44.924962 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25fe5f-c8bf-432d-89a5-954cb957bf48 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:44.957085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:44.957655 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:44.957957 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:44.958742 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:44.997116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:45.023205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:45.024723 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:45.123445 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 562/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:45.129414 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:45.176682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:45.226840 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f28a8-7ece-4132-bb4f-27176a8115ec None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:45.259095 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4123c-d7ee-485f-abfc-b18eb556f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:45.259748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4123c-d7ee-485f-abfc-b18eb556f212 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:45.260022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4123c-d7ee-485f-abfc-b18eb556f212 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:45.260294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4123c-d7ee-485f-abfc-b18eb556f212 None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:45.261408 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4123c-d7ee-485f-abfc-b18eb556f212 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1655aca4944477b8a887cf8e105fe4)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:45.262853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4123c-d7ee-485f-abfc-b18eb556f212 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:45.264449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 554/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:45 2022] GET /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:45.270719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:45.339034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:45.367580 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b718cd-0370-4f32-83f9-1847dfc91157 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:45.400458 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:45.401049 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:45.401356 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:45.401628 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:45.402375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] RBAC: Adding query filter params (role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=fd1655aca4944477b8a887cf8e105fe4, user.id=daed56740c7b4610b701ced4adb60d48) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:45.402683 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:45.404093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fa17a-e915-4ec9-a643-edd747987b63 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:45.409377 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 563/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:45 2022] GET /identity/v3/role_assignments?user.id=daed56740c7b4610b701ced4adb60d48&scope.project.id=fd1655aca4944477b8a887cf8e105fe4&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:47.308770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb55b74-6ab0-4196-976a-8efc00b043aa None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:47.309321 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb55b74-6ab0-4196-976a-8efc00b043aa None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:47.309441 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb55b74-6ab0-4196-976a-8efc00b043aa None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:47.310759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 555/1118] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:47.315867 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:47.316260 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:47.316404 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:47.335171 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:47.336334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:47.400576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 564/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:47.666273 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb55b74-6ab0-4196-976a-8efc00b043aa None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:47.764550 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb55b74-6ab0-4196-976a-8efc00b043aa None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:47.779978 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:47.796667 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:47.807018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:47.807018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:47.807018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] PATH_INFO: `/v3/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:47.807018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] RBAC: Authorizing `identity:get_role(role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:47.807018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:47.807018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 556/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:47 2022] GET /identity/v3/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:47.808230 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:47.870338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:47.903792 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760fca-d3af-40fe-b255-43e65c7f47e7 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:47.936761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:47.937320 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:47.937600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:47.937872 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] PATH_INFO: `/v3/users/daed56740c7b4610b701ced4adb60d48` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:47.939015 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] RBAC: Authorizing `identity:get_user(user_id=daed56740c7b4610b701ced4adb60d48)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:47.940434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:47.942167 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 565/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:47 2022] GET /identity/v3/users/daed56740c7b4610b701ced4adb60d48 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:47.948396 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:48.042937 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd276-7dbc-4db5-b0ac-5be6f4424649 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:48.075180 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737f48-6fcb-4e24-a535-1fc88f4ca1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:48.075789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737f48-6fcb-4e24-a535-1fc88f4ca1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:48.076065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737f48-6fcb-4e24-a535-1fc88f4ca1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:48.076331 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737f48-6fcb-4e24-a535-1fc88f4ca1b6 None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:48.077422 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28737f48-6fcb-4e24-a535-1fc88f4ca1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1655aca4944477b8a887cf8e105fe4)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:48.078848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28737f48-6fcb-4e24-a535-1fc88f4ca1b6 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:48.080437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 557/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:47 2022] GET /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:48.086496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:48.182317 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1dee9-bb7d-49e2-9fc7-2e17812978d2 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:48.215577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b27613-872f-4e93-8b00-2c9f4f54d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:48.215577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27613-872f-4e93-8b00-2c9f4f54d09e None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:48.215806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27613-872f-4e93-8b00-2c9f4f54d09e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:48.216009 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27613-872f-4e93-8b00-2c9f4f54d09e None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4/users/daed56740c7b4610b701ced4adb60d48/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:48.218157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b27613-872f-4e93-8b00-2c9f4f54d09e None admin] RBAC: Authorizing `identity:create_grant(project_id=fd1655aca4944477b8a887cf8e105fe4, user_id=daed56740c7b4610b701ced4adb60d48, role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:48.219637 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b27613-872f-4e93-8b00-2c9f4f54d09e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:48.221784 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:48.311666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 566/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:00:48 2022] PUT /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4/users/daed56740c7b4610b701ced4adb60d48/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:00:50.188135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f870-a827-4731-9c43-1a55d1c9fb29 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:50.188660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f870-a827-4731-9c43-1a55d1c9fb29 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:50.188660 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f870-a827-4731-9c43-1a55d1c9fb29 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:50.190027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 558/1124] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:50.195733 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:50.196134 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:50.196282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:50.214608 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:50.215782 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:50.279996 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 567/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:50.545558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3f870-a827-4731-9c43-1a55d1c9fb29 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:50.597453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:50.644654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3f870-a827-4731-9c43-1a55d1c9fb29 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:50.677186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:50.677808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:50.678113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:50.678380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] PATH_INFO: `/v3/roles/d71a0dd45cbd4fd2b78708b40f60973d` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:50.679759 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] RBAC: Authorizing `identity:get_role(role_id=d71a0dd45cbd4fd2b78708b40f60973d)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:50.681112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:50.682450 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 559/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:50 2022] GET /identity/v3/roles/d71a0dd45cbd4fd2b78708b40f60973d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:50.688254 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:50.783004 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151997-51ca-44dd-8ef7-34cda5d95931 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:50.806326 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:50.816556 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:50.817176 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:50.817448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:50.817710 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] PATH_INFO: `/v3/users/daed56740c7b4610b701ced4adb60d48` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:50.818858 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] RBAC: Authorizing `identity:get_user(user_id=daed56740c7b4610b701ced4adb60d48)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:50.820267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:50.821813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 568/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:50 2022] GET /identity/v3/users/daed56740c7b4610b701ced4adb60d48 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:00:50.827607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:50.924757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7139e0-6adb-4480-8118-1736b6599d29 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:50.943327 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:50.956514 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:50.957146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:50.957423 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:50.957690 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:51.025534 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:51.027018 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:51.121653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 560/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:51.127504 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:51.222791 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765174f-8191-45ba-821b-45766888e1eb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:51.255449 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75f29b-1fb8-4121-acc2-b1582ddeae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:51.256058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75f29b-1fb8-4121-acc2-b1582ddeae82 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:51.256334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75f29b-1fb8-4121-acc2-b1582ddeae82 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:51.256604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75f29b-1fb8-4121-acc2-b1582ddeae82 None admin] PATH_INFO: `/v3/projects/fd1655aca4944477b8a887cf8e105fe4` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:51.257699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75f29b-1fb8-4121-acc2-b1582ddeae82 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1655aca4944477b8a887cf8e105fe4)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:51.259140 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75f29b-1fb8-4121-acc2-b1582ddeae82 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:51.260773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 569/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:51 2022] GET /identity/v3/projects/fd1655aca4944477b8a887cf8e105fe4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:51.266855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:51.288000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:51.363231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0ca23-300f-4e4c-aef8-731bc8ecd60e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:51.396027 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:51.396555 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:51.396834 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:51.397106 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:51.397820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] RBAC: Adding query filter params (role.id=d71a0dd45cbd4fd2b78708b40f60973d, scope.project.id=fd1655aca4944477b8a887cf8e105fe4, user.id=daed56740c7b4610b701ced4adb60d48) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:51.398156 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:51.399566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3e90d-4ce0-45ce-994e-e2e6f6c3ee56 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:51.405097 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 561/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:51 2022] GET /identity/v3/role_assignments?user.id=daed56740c7b4610b701ced4adb60d48&scope.project.id=fd1655aca4944477b8a887cf8e105fe4&role.id=d71a0dd45cbd4fd2b78708b40f60973d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:53.318308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919b1fd-d3e4-4c03-83ff-94e6233ff993 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:53.318825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919b1fd-d3e4-4c03-83ff-94e6233ff993 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:53.318825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919b1fd-d3e4-4c03-83ff-94e6233ff993 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:53.320169 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 570/1131] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:53.325259 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:53.325626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:53.325810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:53.344137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:53.345316 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:53.409143 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 562/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:53.678711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919b1fd-d3e4-4c03-83ff-94e6233ff993 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:53.745848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:53.787806 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919b1fd-d3e4-4c03-83ff-94e6233ff993 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:53.822175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef3e39-5853-4a67-ad00-4e412e9f80a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:53.822794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3e39-5853-4a67-ad00-4e412e9f80a9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:53.823072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3e39-5853-4a67-ad00-4e412e9f80a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:53.823342 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3e39-5853-4a67-ad00-4e412e9f80a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:53.824435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef3e39-5853-4a67-ad00-4e412e9f80a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:53.825847 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef3e39-5853-4a67-ad00-4e412e9f80a9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:53.827427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 571/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:53.833524 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:53.848009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:53.929749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344baf6-aac4-4f09-aa60-e164412ee70e None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:53.963088 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e178b35-56e0-4487-ae3c-15b441c4f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:53.963689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e178b35-56e0-4487-ae3c-15b441c4f29e None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:53.963963 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e178b35-56e0-4487-ae3c-15b441c4f29e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:53.964233 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e178b35-56e0-4487-ae3c-15b441c4f29e None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:53.964867 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e178b35-56e0-4487-ae3c-15b441c4f29e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:53.966363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e178b35-56e0-4487-ae3c-15b441c4f29e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:54.038268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 563/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:00:53 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:55.946899 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a03dd1-6f39-43c2-a15d-d7c8bec97729 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:55.947459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a03dd1-6f39-43c2-a15d-d7c8bec97729 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:55.947459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a03dd1-6f39-43c2-a15d-d7c8bec97729 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:55.948764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 572/1135] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:55.953767 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:55.954175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:55.954350 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:55.972312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:55.984219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:56.031407 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:56.039026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 564/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:56.309423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a03dd1-6f39-43c2-a15d-d7c8bec97729 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:56.407335 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a03dd1-6f39-43c2-a15d-d7c8bec97729 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:56.433988 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:56.441592 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe2d2d-5245-4554-887b-d44ac5022267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:56.442508 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2d2d-5245-4554-887b-d44ac5022267 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:56.447194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2d2d-5245-4554-887b-d44ac5022267 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:56.447194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2d2d-5245-4554-887b-d44ac5022267 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:56.447194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe2d2d-5245-4554-887b-d44ac5022267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:56.447194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe2d2d-5245-4554-887b-d44ac5022267 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:56.447194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 573/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:56.453164 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:56.550686 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547013f4-84c2-415c-87fa-bac4acee4168 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:56.583516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbad5ab-f541-4972-a351-dccafc3e4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:56.584048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad5ab-f541-4972-a351-dccafc3e4b51 None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:56.584325 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad5ab-f541-4972-a351-dccafc3e4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:56.584640 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad5ab-f541-4972-a351-dccafc3e4b51 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:56.585283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad5ab-f541-4972-a351-dccafc3e4b51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:56.586716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad5ab-f541-4972-a351-dccafc3e4b51 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:56.688876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 565/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 11:00:56 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:00:58.638552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bf9b-3939-4bd5-9033-e0122d73b387 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:58.639071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bf9b-3939-4bd5-9033-e0122d73b387 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:58.639071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bf9b-3939-4bd5-9033-e0122d73b387 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:58.640436 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 574/1139] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:00:58.646063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:58.646476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:58.646679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:58.667977 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:00:58.669164 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:00:58.717432 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:58.737743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 566/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:00:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:00:59.014078 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bf9b-3939-4bd5-9033-e0122d73b387 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:59.124914 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bf9b-3939-4bd5-9033-e0122d73b387 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:59.168213 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:59.168832 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:59.169114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:59.169389 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:59.179549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:00:59.184204 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:00:59.185346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:00:59.186625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 575/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:00:59.191449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:59.288391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db1a2-d636-443b-b3a6-9724c0df9f7a None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:59.321494 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:59.322243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:59.322525 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:59.322797 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:59.323459 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:00:59.323760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:59.325110 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:59.334040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 567/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:59.339939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:59.396910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:59.440533 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb07711-1185-496a-929e-e818f795d3c1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:59.473931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:59.474729 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:59.475010 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:59.475282 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] PATH_INFO: `/v3/users/10c9270469ae421b84bb7536d83afff8` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:59.488166 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] RBAC: Authorizing `identity:get_user(user_id=10c9270469ae421b84bb7536d83afff8)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:59.490369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:59.491972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 576/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:00:59 2022] GET /identity/v3/users/10c9270469ae421b84bb7536d83afff8 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:59.498080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:59.543041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:59.595319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718773d-5ae6-4c6f-8cf5-64fea53c3ae4 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:59.627998 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:59.628589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:59.628867 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:59.629135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:59.693971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:59.695400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:59.737069 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:59.789130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 568/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:00:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:00:59.795403 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:00:59.890591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1d9bc-8311-4acc-acc5-2e9c1dea47a5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:00:59.903786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:59.923434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9517-8ee4-41df-abe0-ef91b9acf064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:00:59.924054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9517-8ee4-41df-abe0-ef91b9acf064 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:00:59.924545 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9517-8ee4-41df-abe0-ef91b9acf064 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:00:59.924820 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9517-8ee4-41df-abe0-ef91b9acf064 None admin] PATH_INFO: `/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:00:59.925941 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9517-8ee4-41df-abe0-ef91b9acf064 None admin] RBAC: Authorizing `identity:get_project(project_id=84a3eeca7dcf40daafa7a5d6bd70f28b)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:00:59.927934 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9517-8ee4-41df-abe0-ef91b9acf064 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:00:59.929532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 577/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:00:59 2022] GET /identity/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:00:59.935648 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:00.042977 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859373d-c6ff-4bdf-81d7-ea4d09abc31b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:00.076315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:00.076847 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:00.077122 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:00.077393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:00.078138 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=84a3eeca7dcf40daafa7a5d6bd70f28b, user.id=10c9270469ae421b84bb7536d83afff8) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:00.078443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:00.079857 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d107f14-cd09-4bb7-80d4-461df47247d0 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:00.084956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 569/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:00:59 2022] GET /identity/v3/role_assignments?user.id=10c9270469ae421b84bb7536d83afff8&scope.project.id=84a3eeca7dcf40daafa7a5d6bd70f28b&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:01.941365 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1df8-c3ee-4bec-aee6-651b57aec174 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:01.941893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1df8-c3ee-4bec-aee6-651b57aec174 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:01.941893 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1df8-c3ee-4bec-aee6-651b57aec174 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:01.943329 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 578/1147] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:01.949542 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:01.949947 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:01.950120 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:01.967546 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:01.968705 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:01.970636 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:02.033307 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 570/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:02.298882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1df8-c3ee-4bec-aee6-651b57aec174 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:02.396530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1df8-c3ee-4bec-aee6-651b57aec174 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:02.429183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:02.429796 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:02.430103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:02.430376 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:02.440262 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:01:02.444964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:01:02.446072 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:01:02.450991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 579/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:01:02.452137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:02.547369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ace3-50ad-4856-8244-6fe414d40bee None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:02.581191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:02.581730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:02.582032 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:02.582832 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:02.583482 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:02.583781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:02.585125 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:02.589852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:02.593057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 571/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:02.599939 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:02.642597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:02.696738 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80d09-b311-4fba-878d-b6a25d2c5bc1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:02.729657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:02.730296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:02.730576 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:02.730846 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] PATH_INFO: `/v3/users/10c9270469ae421b84bb7536d83afff8` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:02.731940 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] RBAC: Authorizing `identity:get_user(user_id=10c9270469ae421b84bb7536d83afff8)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:02.733346 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:02.734927 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 580/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:01:02 2022] GET /identity/v3/users/10c9270469ae421b84bb7536d83afff8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:02.740733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:02.837283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecbe48-ec53-4e85-8228-84ad1e978dbe None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:02.868626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a47e-d912-4fbe-a26e-ef22521538cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:02.869238 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a47e-d912-4fbe-a26e-ef22521538cb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:02.869519 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a47e-d912-4fbe-a26e-ef22521538cb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:02.869789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a47e-d912-4fbe-a26e-ef22521538cb None admin] PATH_INFO: `/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:02.870913 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a47e-d912-4fbe-a26e-ef22521538cb None admin] RBAC: Authorizing `identity:get_project(project_id=84a3eeca7dcf40daafa7a5d6bd70f28b)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:02.872322 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a47e-d912-4fbe-a26e-ef22521538cb None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:02.873931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 572/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:01:02 2022] GET /identity/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:02.880898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:02.975848 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888a2f9-4d97-40c3-a9d8-63fbd8b3ebb0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:02.985902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:03.008634 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e29ccc-f4a8-45da-bfee-5d65d0318dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:03.009268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e29ccc-f4a8-45da-bfee-5d65d0318dbf None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:03.009545 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e29ccc-f4a8-45da-bfee-5d65d0318dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:03.009814 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e29ccc-f4a8-45da-bfee-5d65d0318dbf None admin] PATH_INFO: `/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b/users/10c9270469ae421b84bb7536d83afff8/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:03.011709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e29ccc-f4a8-45da-bfee-5d65d0318dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=84a3eeca7dcf40daafa7a5d6bd70f28b, user_id=10c9270469ae421b84bb7536d83afff8, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:03.013110 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e29ccc-f4a8-45da-bfee-5d65d0318dbf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:03.072200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 581/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:01:02 2022] PUT /identity/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b/users/10c9270469ae421b84bb7536d83afff8/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:01:04.952841 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773ab7-a5e3-4789-af1b-ba2b15e3394e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:04.953400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773ab7-a5e3-4789-af1b-ba2b15e3394e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:04.953400 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773ab7-a5e3-4789-af1b-ba2b15e3394e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:04.954739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 573/1154] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:04.960510 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:04.960906 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:04.961055 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:04.979787 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:04.980949 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:05.045091 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 582/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:05.314136 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773ab7-a5e3-4789-af1b-ba2b15e3394e None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:05.380518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:05.414543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773ab7-a5e3-4789-af1b-ba2b15e3394e None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:05.446325 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:05.446942 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:05.447219 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:05.447488 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:05.458146 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:01:05.462790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:01:05.463886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:05.464918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:01:05.466069 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 574/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:01:05.469819 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:05.562052 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:05.564776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a48b2-666a-453c-bc4d-0a0aa09a4a9a None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:05.597357 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:05.598641 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:05.598919 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:05.599185 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:05.599838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:05.600137 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:05.601481 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:05.609062 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 583/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:05.615179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:05.711966 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0975-40ec-493e-920b-94c31e57837c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:05.736041 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:05.743911 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:05.744523 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:05.748070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:05.748070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] PATH_INFO: `/v3/users/10c9270469ae421b84bb7536d83afff8` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:05.748070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=10c9270469ae421b84bb7536d83afff8)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:05.748070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:05.749119 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 575/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:01:05 2022] GET /identity/v3/users/10c9270469ae421b84bb7536d83afff8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:05.755618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:05.851486 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de08244-e131-4910-b6ef-b6655050079c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:05.883097 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:05.883685 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:05.883967 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:05.884234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:05.912699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:05.948177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:05.949596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:06.042907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 584/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:01:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:01:06.048781 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:06.144089 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ef28-4120-4e69-955f-e0ee84ea1dd2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:06.177001 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee4ff5-b8df-4099-ba2b-0e93f1c86387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:06.177607 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4ff5-b8df-4099-ba2b-0e93f1c86387 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:06.177882 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4ff5-b8df-4099-ba2b-0e93f1c86387 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:06.178183 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4ff5-b8df-4099-ba2b-0e93f1c86387 None admin] PATH_INFO: `/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:06.179278 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee4ff5-b8df-4099-ba2b-0e93f1c86387 None admin] RBAC: Authorizing `identity:get_project(project_id=84a3eeca7dcf40daafa7a5d6bd70f28b)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:06.180685 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee4ff5-b8df-4099-ba2b-0e93f1c86387 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:06.182305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 576/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:01:06 2022] GET /identity/v3/projects/84a3eeca7dcf40daafa7a5d6bd70f28b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:06.188264 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:06.246606 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:06.290419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d13f-22ae-4827-a08b-8816aa816925 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:06.323071 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:06.323663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:06.323942 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:06.324212 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:06.324918 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=84a3eeca7dcf40daafa7a5d6bd70f28b, user.id=10c9270469ae421b84bb7536d83afff8) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:06.325221 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:06.326647 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a520a-1acb-4337-82e9-c67da2f7ac30 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:06.332638 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 585/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:01:06 2022] GET /identity/v3/role_assignments?user.id=10c9270469ae421b84bb7536d83afff8&scope.project.id=84a3eeca7dcf40daafa7a5d6bd70f28b&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:08.244157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d4b5-a747-410e-92b3-a336f451ab14 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:08.244701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d4b5-a747-410e-92b3-a336f451ab14 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:08.244794 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d4b5-a747-410e-92b3-a336f451ab14 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:08.246096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 577/1162] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:08.251353 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:08.251726 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:08.251907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:08.269785 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:08.271043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:08.336026 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 586/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:08.605031 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d4b5-a747-410e-92b3-a336f451ab14 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:08.664988 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:08.703105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d4b5-a747-410e-92b3-a336f451ab14 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:08.736423 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:08.737016 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:08.737292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:08.737560 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:08.801536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:08.802987 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:08.858789 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:08.895732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 578/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:01:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:01:08.901661 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:08.954511 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:08.996054 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ffc23-f248-4d86-a7fd-036e5f434395 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:09.028425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:09.029042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:09.029319 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:09.029587 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:09.036528 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:09.037965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-40856a44-bccf-4b82-ad5e-c4e4ee3ecc0e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:01:09.048961 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:01:09.050159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:01:09.051632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 587/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:01:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:01:09.056750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:09.150693 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9658b6-e196-433e-b62e-b2503c08b304 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:09.183036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:09.183624 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:09.183901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:09.184169 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:09.184800 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:09.185096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:09.186461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0944f3-dd16-4913-81fc-514bf48dcdf5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:09.193267 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 579/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Aug 12 11:01:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:11.077220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d643-7c1e-4872-afc9-698d1010f952 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:11.077776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d643-7c1e-4872-afc9-698d1010f952 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:11.077776 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d643-7c1e-4872-afc9-698d1010f952 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:11.079142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 588/1167] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:11.084816 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46decb54-7c9b-4469-8f7d-82ed28f00b16 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:11.085232 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46decb54-7c9b-4469-8f7d-82ed28f00b16 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:11.085359 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46decb54-7c9b-4469-8f7d-82ed28f00b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:11.102813 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-46decb54-7c9b-4469-8f7d-82ed28f00b16 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:11.103971 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-46decb54-7c9b-4469-8f7d-82ed28f00b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:11.125319 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:11.166872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 580/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:11.434348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d643-7c1e-4872-afc9-698d1010f952 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:11.531860 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d643-7c1e-4872-afc9-698d1010f952 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:11.547856 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:11.565414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637634a-9e9c-49f2-a4ab-c7667af76d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:11.566042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637634a-9e9c-49f2-a4ab-c7667af76d31 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:11.566325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637634a-9e9c-49f2-a4ab-c7667af76d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:11.566594 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637634a-9e9c-49f2-a4ab-c7667af76d31 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:11.567387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637634a-9e9c-49f2-a4ab-c7667af76d31 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:11.569423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637634a-9e9c-49f2-a4ab-c7667af76d31 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:11.661138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 589/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Fri Aug 12 11:01:11 2022] POST /identity/v3/domains => generated 267 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:01:13.568318 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676860b-8b5c-48eb-814a-6800a4a2a222 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:13.568852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676860b-8b5c-48eb-814a-6800a4a2a222 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:13.568852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676860b-8b5c-48eb-814a-6800a4a2a222 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:13.570238 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 581/1170] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:13.575291 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:13.575670 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:13.575829 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:13.593890 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:13.595083 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:13.657559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 590/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:13.922825 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676860b-8b5c-48eb-814a-6800a4a2a222 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:14.021357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676860b-8b5c-48eb-814a-6800a4a2a222 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:14.054898 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7015cc3-9f26-4385-bd20-99c72057fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:14.055510 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015cc3-9f26-4385-bd20-99c72057fd5a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:14.055790 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015cc3-9f26-4385-bd20-99c72057fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:14.056065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015cc3-9f26-4385-bd20-99c72057fd5a None admin] PATH_INFO: `/v3/domains/87a20a0499e146cd8dd7d0bb346e3931` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:14.066050 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7015cc3-9f26-4385-bd20-99c72057fd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=87a20a0499e146cd8dd7d0bb346e3931)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:14.067471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7015cc3-9f26-4385-bd20-99c72057fd5a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:14.069252 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 582/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Fri Aug 12 11:01:13 2022] GET /identity/v3/domains/87a20a0499e146cd8dd7d0bb346e3931 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:14.075063 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:14.169879 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ee461-3555-4313-be80-e4c9ee1ed3fb None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:14.176850 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:14.202164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b891d7b-b2ee-4831-9f6a-fa0c5fb83e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:14.202762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b891d7b-b2ee-4831-9f6a-fa0c5fb83e9d None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:14.203040 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b891d7b-b2ee-4831-9f6a-fa0c5fb83e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:14.203311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b891d7b-b2ee-4831-9f6a-fa0c5fb83e9d None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:14.203943 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b891d7b-b2ee-4831-9f6a-fa0c5fb83e9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:14.205355 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b891d7b-b2ee-4831-9f6a-fa0c5fb83e9d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:14.341347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 591/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:01:14 2022] POST /identity/v3/projects => generated 361 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:01:16.263192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fab09-90ae-477c-9a8a-50de68af999f None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:16.263776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fab09-90ae-477c-9a8a-50de68af999f None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:16.263776 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fab09-90ae-477c-9a8a-50de68af999f None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:16.265110 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 583/1174] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:16.270187 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:16.270621 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:16.270720 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:16.288596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:16.289747 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:16.354877 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 592/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:16.621051 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fab09-90ae-477c-9a8a-50de68af999f None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:16.640192 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:16.720742 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fab09-90ae-477c-9a8a-50de68af999f None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:16.753782 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6239e-91b5-4662-9ebf-7a274f2be949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:16.754430 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6239e-91b5-4662-9ebf-7a274f2be949 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:16.754711 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6239e-91b5-4662-9ebf-7a274f2be949 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:16.754983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6239e-91b5-4662-9ebf-7a274f2be949 None admin] PATH_INFO: `/v3/domains/87a20a0499e146cd8dd7d0bb346e3931` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:16.756092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6239e-91b5-4662-9ebf-7a274f2be949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=87a20a0499e146cd8dd7d0bb346e3931)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:16.757673 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6239e-91b5-4662-9ebf-7a274f2be949 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:16.759257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 584/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Fri Aug 12 11:01:16 2022] GET /identity/v3/domains/87a20a0499e146cd8dd7d0bb346e3931 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:16.765043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:16.848785 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:16.860534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6ed7a-14f2-42f5-8857-8b1d85f23094 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:16.894093 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84ccc5-fe37-4323-a293-5bf0af7fdf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:16.894632 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84ccc5-fe37-4323-a293-5bf0af7fdf82 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:16.894910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84ccc5-fe37-4323-a293-5bf0af7fdf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:16.895180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84ccc5-fe37-4323-a293-5bf0af7fdf82 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:16.895813 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84ccc5-fe37-4323-a293-5bf0af7fdf82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:16.897946 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84ccc5-fe37-4323-a293-5bf0af7fdf82 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:16.968434 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 593/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 11:01:16 2022] POST /identity/v3/users => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:01:18.898841 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4281-13fb-4403-a1f7-ec4d980ac7ab None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:18.899379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4281-13fb-4403-a1f7-ec4d980ac7ab None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:18.899379 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4281-13fb-4403-a1f7-ec4d980ac7ab None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:18.900719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 585/1178] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:18.905746 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:18.906183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:18.906313 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:18.924743 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:18.925903 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:18.988926 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 594/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:19.258116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4281-13fb-4403-a1f7-ec4d980ac7ab None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:19.340429 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.355799 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4281-13fb-4403-a1f7-ec4d980ac7ab None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:19.388515 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:19.389126 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:19.389411 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:19.389679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:19.399348 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:01:19.403901 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:01:19.405030 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:01:19.406131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 586/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:01:19.410990 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:19.483663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.507570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae5ee-272f-4cb6-9399-b78136c8d6be None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:19.541771 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:19.542347 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:19.542635 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:19.542907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:19.543567 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:19.543868 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:19.545217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:19.552903 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 595/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:19.559285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:19.656074 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30604657-ddfb-407e-ba41-54b0455b8eb6 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:19.689567 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:19.690211 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:19.690489 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:19.690761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] PATH_INFO: `/v3/users/f6562fcbe5314eaf9858b8e4ef351192` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:19.703903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] RBAC: Authorizing `identity:get_user(user_id=f6562fcbe5314eaf9858b8e4ef351192)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:19.705323 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:19.706918 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 587/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:01:19 2022] GET /identity/v3/users/f6562fcbe5314eaf9858b8e4ef351192 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:19.712740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:19.808184 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd76a49-a8e7-4739-812a-91b01c798d89 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:19.841036 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:19.841630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:19.841908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:19.842209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:19.845465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.906681 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:19.908121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:20.003003 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 596/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:01:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:01:20.009513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:20.013256 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:20.106067 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588882-33fb-452b-852b-e86b64664100 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:20.137844 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4fcc0-f3ce-412c-bf66-68e930fa90de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:20.138487 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4fcc0-f3ce-412c-bf66-68e930fa90de None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:20.138768 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4fcc0-f3ce-412c-bf66-68e930fa90de None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:20.139039 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4fcc0-f3ce-412c-bf66-68e930fa90de None admin] PATH_INFO: `/v3/projects/d16c9540526043d1a8fa24c9a86ae46b` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:20.140145 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4fcc0-f3ce-412c-bf66-68e930fa90de None admin] RBAC: Authorizing `identity:get_project(project_id=d16c9540526043d1a8fa24c9a86ae46b)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:20.141552 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4fcc0-f3ce-412c-bf66-68e930fa90de None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:20.143189 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 588/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:01:20 2022] GET /identity/v3/projects/d16c9540526043d1a8fa24c9a86ae46b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:20.149905 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:20.182656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:20.244854 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a1efb-d9bc-43bc-800f-f4e736942d5e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:20.277499 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:20.278113 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:20.278389 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:20.278656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:20.279363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=d16c9540526043d1a8fa24c9a86ae46b, user.id=f6562fcbe5314eaf9858b8e4ef351192) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:20.279673 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:20.281082 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d651f-d485-480c-b484-024a5cd1cdbf None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:20.286210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 597/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:01:20 2022] GET /identity/v3/role_assignments?user.id=f6562fcbe5314eaf9858b8e4ef351192&scope.project.id=d16c9540526043d1a8fa24c9a86ae46b&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:22.136630 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b109-cd51-4572-8a55-213a14d1be84 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:22.137191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b109-cd51-4572-8a55-213a14d1be84 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:22.137191 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b109-cd51-4572-8a55-213a14d1be84 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:22.138553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 589/1186] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:22.143687 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:22.144097 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:22.144233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:22.162507 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:22.164368 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:22.229341 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 598/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:01:22.502703 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b109-cd51-4572-8a55-213a14d1be84 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:22.578874 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:22.607894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b109-cd51-4572-8a55-213a14d1be84 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:22.641371 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:22.642009 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:22.642294 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:22.642569 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:22.652747 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:01:22.657357 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:01:22.658443 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:01:22.659597 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 590/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:01:22.664498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:22.695013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:22.762380 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855468cd-8fc3-4037-8925-79598af68ce5 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:22.795050 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:22.795645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:22.795927 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:22.796202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:22.796857 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:22.797161 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:22.798548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:22.807011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 599/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:01:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:22.812760 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:22.908860 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6c0ca-2f1b-4045-80ba-10c1cd9fe691 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:22.937433 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:22.942958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:22.943578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:22.943963 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:22.944268 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] PATH_INFO: `/v3/users/f6562fcbe5314eaf9858b8e4ef351192` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:22.947312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] RBAC: Authorizing `identity:get_user(user_id=f6562fcbe5314eaf9858b8e4ef351192)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:22.947312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:22.948463 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 591/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:01:22 2022] GET /identity/v3/users/f6562fcbe5314eaf9858b8e4ef351192 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:22.954402 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:23.043039 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:23.051327 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea898f5-2567-4345-a4b3-a0e02dbc2707 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:23.083745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf57ac-01bb-4fa0-8df3-5de2330c4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:23.084358 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf57ac-01bb-4fa0-8df3-5de2330c4e6e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:23.084664 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf57ac-01bb-4fa0-8df3-5de2330c4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:23.084944 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf57ac-01bb-4fa0-8df3-5de2330c4e6e None admin] PATH_INFO: `/v3/projects/d16c9540526043d1a8fa24c9a86ae46b` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:23.086074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf57ac-01bb-4fa0-8df3-5de2330c4e6e None admin] RBAC: Authorizing `identity:get_project(project_id=d16c9540526043d1a8fa24c9a86ae46b)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:23.087496 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf57ac-01bb-4fa0-8df3-5de2330c4e6e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:23.089103 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 600/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:01:22 2022] GET /identity/v3/projects/d16c9540526043d1a8fa24c9a86ae46b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:23.094958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:23.190571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06660-1653-4de8-9e49-53e51ffc5d9e None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:23.222373 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e0b07-9a43-416f-8505-57d8dd9af10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:23.222945 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e0b07-9a43-416f-8505-57d8dd9af10b None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:23.223220 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e0b07-9a43-416f-8505-57d8dd9af10b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:23.223489 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e0b07-9a43-416f-8505-57d8dd9af10b None admin] PATH_INFO: `/v3/projects/d16c9540526043d1a8fa24c9a86ae46b/users/f6562fcbe5314eaf9858b8e4ef351192/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:23.225852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e0b07-9a43-416f-8505-57d8dd9af10b None admin] RBAC: Authorizing `identity:create_grant(project_id=d16c9540526043d1a8fa24c9a86ae46b, user_id=f6562fcbe5314eaf9858b8e4ef351192, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:23.227274 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e0b07-9a43-416f-8505-57d8dd9af10b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:23.311388 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 592/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:01:23 2022] PUT /identity/v3/projects/d16c9540526043d1a8fa24c9a86ae46b/users/f6562fcbe5314eaf9858b8e4ef351192/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:01:25.186328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f0a9f-54cf-4634-b182-05c5bf7d6427 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:25.186871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f0a9f-54cf-4634-b182-05c5bf7d6427 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:25.186871 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f0a9f-54cf-4634-b182-05c5bf7d6427 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:25.188205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 601/1193] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:01:25.193285 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:25.194221 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:25.194617 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:25.212890 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:01:25.214108 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:25.266934 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:25.277578 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 593/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:01:25.549593 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f0a9f-54cf-4634-b182-05c5bf7d6427 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:25.647688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f0a9f-54cf-4634-b182-05c5bf7d6427 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:25.679764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:25.680367 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:25.680644 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:25.680912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:25.690965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:01:25.695609 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:01:25.696701 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:01:25.697591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 602/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:01:25.702732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:25.798551 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee008d0-e8f4-45e1-a1e2-41bd9eb5ec80 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:25.830865 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:25.831455 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:25.831734 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:25.832002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:25.832653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:25.832958 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:25.834875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:25.842748 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 594/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:25.848435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:25.870030 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:25.946271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d91c-9431-4a4a-981b-675c841f3833 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:25.978293 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:25.978907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:25.979182 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:25.979448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] PATH_INFO: `/v3/users/f6562fcbe5314eaf9858b8e4ef351192` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:25.980548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] RBAC: Authorizing `identity:get_user(user_id=f6562fcbe5314eaf9858b8e4ef351192)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:25.981991 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:25.983552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 603/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Aug 12 11:01:25 2022] GET /identity/v3/users/f6562fcbe5314eaf9858b8e4ef351192 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:25.989526 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:26.039983 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:26.084355 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d12f-88d0-4273-8917-b8f31abca060 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:26.116442 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:26.117131 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:26.117409 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:26.117678 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:26.181318 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:26.182771 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:26.230360 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:26.275227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 595/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:01:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:01:26.281079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:26.366308 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:26.377570 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3165-4f23-4d6b-a500-1eca0e267614 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:26.409695 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1464fb1-ccfa-48bc-ae90-ea32e8d343f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:26.410332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1464fb1-ccfa-48bc-ae90-ea32e8d343f9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:26.410610 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1464fb1-ccfa-48bc-ae90-ea32e8d343f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:26.410882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1464fb1-ccfa-48bc-ae90-ea32e8d343f9 None admin] PATH_INFO: `/v3/projects/d16c9540526043d1a8fa24c9a86ae46b` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:26.411975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1464fb1-ccfa-48bc-ae90-ea32e8d343f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d16c9540526043d1a8fa24c9a86ae46b)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:26.413980 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1464fb1-ccfa-48bc-ae90-ea32e8d343f9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:26.415582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 604/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Aug 12 11:01:26 2022] GET /identity/v3/projects/d16c9540526043d1a8fa24c9a86ae46b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:26.422048 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:26.516367 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106c47-5dd6-43dc-8758-4ac99d46ea9a None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:26.550734 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:26.551332 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:26.551612 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:26.551884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:26.552601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=d16c9540526043d1a8fa24c9a86ae46b, user.id=f6562fcbe5314eaf9858b8e4ef351192) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:01:26.552908 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:26.554469 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7a41-66db-4d0e-84c5-12705792e73c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:26.559956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 596/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:01:26 2022] GET /identity/v3/role_assignments?user.id=f6562fcbe5314eaf9858b8e4ef351192&scope.project.id=d16c9540526043d1a8fa24c9a86ae46b&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:01:36.405633 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=22 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:36.557417 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=92 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:37.134385 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e08e-b99e-4ade-9b90-b8c114191cf5 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:37.134985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e08e-b99e-4ade-9b90-b8c114191cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:37.134985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e08e-b99e-4ade-9b90-b8c114191cf5 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:37.136232 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 605/1201] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:02:37.141280 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:37.141721 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:37.141821 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:37.160099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:02:37.161236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:02:37.227663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 597/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:02:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:02:37.502902 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29e08e-b99e-4ade-9b90-b8c114191cf5 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:37.603423 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29e08e-b99e-4ade-9b90-b8c114191cf5 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:37.635816 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:37.636426 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:37.636702 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:37.636971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:37.647180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:37.648795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:37.663173 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:37.664363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:37.665704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:37.665704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:37.665704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:37.665704 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 606/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:37.670639 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:37.768297 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d2c12-877a-4058-a401-f37b8ee10427 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:37.796719 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:37.802484 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:37.803085 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:37.803366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:37.804160 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:37.804819 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:37.805121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:37.806562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf90a1b-6f08-42fa-8af7-0736b91eee21 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:37.817470 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 598/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:37.824016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:37.876337 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:37.922589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89374-e4a5-464e-9c3b-73cff5e37e83 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:37.955997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61350f-bf75-4903-b810-1c6aec900449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:37.956595 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61350f-bf75-4903-b810-1c6aec900449 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:37.956882 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61350f-bf75-4903-b810-1c6aec900449 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:37.957154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61350f-bf75-4903-b810-1c6aec900449 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:37.957793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61350f-bf75-4903-b810-1c6aec900449 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:37.959247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61350f-bf75-4903-b810-1c6aec900449 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:38.052398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 607/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Aug 12 11:02:37 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:02:39.982545 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b58a5-9618-4510-8b53-bbce271e636e None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:39.983112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b58a5-9618-4510-8b53-bbce271e636e None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:39.983112 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b58a5-9618-4510-8b53-bbce271e636e None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:39.984434 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 599/1206] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:02:39.989597 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:39.990069 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:39.990177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:40.008972 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:02:40.010178 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:02:40.076717 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 608/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:02:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:02:40.347069 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b58a5-9618-4510-8b53-bbce271e636e None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:40.448930 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b58a5-9618-4510-8b53-bbce271e636e None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:40.483985 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:40.484609 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:40.484888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:40.485157 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:40.495293 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:02:40.499946 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:40.501056 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:40.502046 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 600/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 11:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:40.507146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:40.545960 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:40.605286 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28225ea-be02-4a1a-bcd3-d1d1e37fcec1 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:40.637328 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:40.637949 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:40.638233 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:40.638504 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:40.639164 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:40.639465 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:40.640815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:40.648886 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 609/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 11:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:02:40.654716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:40.703558 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:40.752904 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b9e5-527a-410a-afeb-7a325015aaf5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:40.787084 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:40.787793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:40.788227 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:40.788511 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:40.799224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:40.800642 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:40.815057 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:40.816099 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:40.817115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:40.817115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:40.817115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:40.817115 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 601/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:40.823018 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:40.922951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:40.925786 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fb2da-03e8-44b5-a6e8-cd8915c15b7d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:40.958721 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:40.959371 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:40.959698 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:40.959993 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:40.960639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:40.960964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:40.962356 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:40.973756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 610/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:40.980226 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:41.078894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527cef-d71a-47f7-9bf3-b3c99a8a5c16 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:41.080464 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:41.111687 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:41.112305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:41.112584 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:41.112855 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:41.120673 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:41.122137 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:02:41.133939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:41.135150 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:41.136461 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 602/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:41.140930 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:41.242318 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3e5a-dc9e-494f-8be1-2a0e785b7cfb None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:41.275656 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:41.276250 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:41.276527 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:41.276793 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:41.277505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:41.277805 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:41.279247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:41.296723 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 611/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Aug 12 11:02:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:41.302894 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:41.401848 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f666-9c84-44a0-861a-348ea8ec3064 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:41.436152 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:41.437135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:41.437135 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:41.437304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:41.466739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:41.503363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:41.504870 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:41.601096 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 603/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:02:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:02:41.607020 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:41.625202 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:41.704614 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a612d-c5a4-4997-9fe8-3a6156480f48 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:41.739222 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:41.739841 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:41.740116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:41.740387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:41.750139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:41.751562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:41.766267 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:41.767369 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:41.768462 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:41.768462 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:41.768462 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:41.768462 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 612/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:41.774149 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:41.835664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:41.873006 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3135e9-a769-435c-870b-e3812cf4292d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:41.906671 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:41.907272 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:41.907553 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:41.907829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:41.908480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:41.908903 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:41.910312 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:41.922130 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 604/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:41.928089 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:41.995488 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:42.025751 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a6b-372c-48c0-a4a9-ff055f13bbb0 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:42.058081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:42.058725 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:42.059019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:42.059290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:42.065688 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:42.067154 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:02:42.078591 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:42.079707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:42.080818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 613/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:42.085884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:42.185223 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0812f8-46ea-44e7-ab52-8c9ddffe8bd5 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:42.208175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:42.219363 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:42.219963 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:42.220244 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:42.220519 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:42.221203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:42.221509 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:42.222965 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4d533-2c73-40a2-bed5-0f24c919caad None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:42.233938 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 605/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:02:42.240280 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:42.341252 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ec96-f084-4345-af44-bb96baf7a8a9 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:42.370239 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:42.375931 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:42.376530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:42.376811 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:42.377084 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:42.377802 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2414041e42704c978eff55e37c661221) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:42.378139 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:42.379627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311dbbb-b778-43b7-a5e6-1814756d31dc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:42.385160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 614/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:02:42 2022] GET /identity/v3/role_assignments?user.id=2414041e42704c978eff55e37c661221&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:44.238171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59167f61-be9c-4139-8d4d-71eb9ca6a9be None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:44.238735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59167f61-be9c-4139-8d4d-71eb9ca6a9be None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:44.238735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59167f61-be9c-4139-8d4d-71eb9ca6a9be None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:44.240083 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 606/1220] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:02:44.245679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:44.246157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:44.246249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:44.264596 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:02:44.265761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:02:44.330864 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 615/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:02:44.598200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59167f61-be9c-4139-8d4d-71eb9ca6a9be None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:44.700979 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59167f61-be9c-4139-8d4d-71eb9ca6a9be None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:44.734471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:44.735092 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:44.735374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:44.735674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:44.746209 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:02:44.750796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:44.751909 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:44.752952 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 607/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 11:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:44.757950 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:44.856749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56698ae8-e42b-45f7-a24d-4f3c3d474e12 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:44.879625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:44.890138 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:44.890773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:44.891161 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:44.891332 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:44.892008 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:44.892289 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:44.893639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:44.901388 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 616/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 11:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:44.907462 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:44.951580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:45.006749 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26547-134a-4cd7-840e-1d8636c9e0fb None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:45.041162 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:45.041796 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:45.042109 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:45.042386 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:45.052301 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:45.053761 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:45.068689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:45.073536 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:45.074679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:45.074679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:45.074679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:45.074679 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 608/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:45.076157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:45.174666 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af289-5ef1-473b-8755-06ff4ee7d5a1 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:45.208955 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:45.210128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:45.210410 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:45.210803 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:45.211415 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:45.211718 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:45.213074 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:45.224582 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 617/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:45.230927 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:45.323257 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:45.329646 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf87f5b-5bcf-4e66-a76b-61de36cea08b None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:45.362375 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:45.362996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:45.363272 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:45.363539 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:45.371405 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:45.372835 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:02:45.384571 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:45.387583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:45.388762 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 609/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:45.391482 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:45.438305 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:45.489231 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a154d-59bd-4fdf-99eb-cab531469d8b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:45.522730 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:45.523335 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:45.523612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:45.523881 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:45.524636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:45.524912 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:45.526703 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:45.543969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 618/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Aug 12 11:02:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:45.549778 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:45.647516 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da9f91-7d21-48ca-99c8-1655734ccb6c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:45.680620 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:45.681228 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:45.681504 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:45.681770 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:45.692087 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:45.693451 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:45.709231 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:45.713680 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:45.714829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:45.714829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:45.714829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:45.714829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 610/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:45.716177 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:45.814976 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9167-19f4-42e2-9dcd-f94e15d80d8e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:45.817224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:45.848290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:45.849008 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:45.849290 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:45.849613 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:45.851101 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:45.851390 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:45.852744 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:45.863612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 619/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:45.869305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:45.878629 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:45.969206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758be3-f11b-4462-a387-42e6e3ffdca1 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:46.002554 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:46.003171 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:46.003446 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:46.003713 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:46.010414 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:46.011827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:02:46.023581 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:46.024655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:46.025585 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 611/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:46.030802 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:46.130348 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a42d0-b773-4ed7-8d82-700bbb540cfc None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:46.163209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:46.163795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:46.164073 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:46.164340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:46.165016 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:46.165355 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:46.167059 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74727f-a866-41a0-a471-033297eb7002 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:46.178945 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 620/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:46.185218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:46.251418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:46.284529 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1cff-d782-415b-a6a5-57e2fa1a97a7 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:46.318329 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b62c-a63b-4402-a0f3-1af8ad6865d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:46.319022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b62c-a63b-4402-a0f3-1af8ad6865d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:46.319374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b62c-a63b-4402-a0f3-1af8ad6865d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:46.319675 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b62c-a63b-4402-a0f3-1af8ad6865d1 None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2414041e42704c978eff55e37c661221/roles/dc6bd2aa9093476aa45c05cd4d930025` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:46.334480 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b62c-a63b-4402-a0f3-1af8ad6865d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=2414041e42704c978eff55e37c661221, role_id=dc6bd2aa9093476aa45c05cd4d930025)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:46.335996 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b62c-a63b-4402-a0f3-1af8ad6865d1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:46.394603 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 612/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:02:46 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2414041e42704c978eff55e37c661221/roles/dc6bd2aa9093476aa45c05cd4d930025 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:02:48.274571 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ba95-4813-49d3-b560-1270d32bb56e None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:48.275194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ba95-4813-49d3-b560-1270d32bb56e None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:48.275194 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ba95-4813-49d3-b560-1270d32bb56e None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:48.276526 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 621/1233] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:02:48.282002 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:48.282446 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:48.282543 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:48.301735 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:02:48.303061 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:02:48.368000 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 613/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:02:48.642625 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ba95-4813-49d3-b560-1270d32bb56e None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:48.668230 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:48.740964 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ba95-4813-49d3-b560-1270d32bb56e None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:48.773441 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:48.774075 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:48.774352 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:48.774618 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:48.784146 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:02:48.789767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:48.791224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:02:48.792128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:48.794083 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 622/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Aug 12 11:02:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:48.798600 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:48.842367 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:48.893052 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e54d-c9fa-4b86-81d0-547d9f6fc0f9 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:48.926077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:48.926688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:48.927178 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:48.927466 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:48.928626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:48.928980 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:48.930398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:48.938105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 614/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Aug 12 11:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:48.943838 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:49.027754 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:49.043454 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4221f-2f90-43a4-b838-ed29d33d0c9e None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:49.075773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:49.076394 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:49.076670 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:49.076937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:49.087792 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:49.089217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:49.103314 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:49.104459 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:49.105422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:49.105422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:49.105422 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:49.106418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 623/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:49.110449 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:49.212366 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a8f8-204a-45d6-84b5-66443ed295f9 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:49.221026 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:49.245309 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:49.245910 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:49.246218 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:49.246490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:49.247127 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:49.247428 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:49.248895 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:49.260860 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 615/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:49.266758 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:49.366079 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4559-33e4-4483-98d4-73c4066d659c None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:49.399203 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:49.399831 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:49.400104 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:49.400374 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:49.403331 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:49.408763 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:49.416188 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:02:49.421338 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:49.422830 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:49.424043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 624/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:49.428845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:49.526111 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b725c-4e84-4cc9-991c-eedafedd6a51 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:49.559133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:49.559685 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:49.559964 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:49.560233 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:49.560956 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:49.561254 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:49.562698 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:49.579287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 616/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Aug 12 11:02:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:49.585574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:49.685142 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220252d6-5120-427f-9129-ea1cdc8c8160 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:49.717583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:49.718209 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:49.718488 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:49.718766 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:49.779719 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:49.786061 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:49.787540 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:49.884589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 625/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:02:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:02:49.890389 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:49.917688 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:49.988038 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760079-bd32-4e31-8c74-531f6ec2fd35 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:50.023453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:50.024069 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:50.024347 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:50.024616 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:50.034573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:50.035949 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:50.050866 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:50.056561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:50.057591 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:50.057591 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:50.057591 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:50.057591 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 617/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:50.058555 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:50.150997 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:50.156645 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c694de3-0c64-46d3-be88-bad0a1679144 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:50.189987 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:50.190574 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:50.190849 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:50.191116 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:50.191749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:50.192046 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:50.193387 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:50.210445 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 626/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:50.216391 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:50.296121 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:50.316592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb09d4-ab72-4e33-b8c8-da1459e819ed None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:50.349085 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:50.349716 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:50.350568 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:50.350923 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:50.357334 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:50.358852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:02:50.369562 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:50.370707 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:50.371744 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 618/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:50.376770 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:50.478183 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0ad5-53dd-42f8-a2ac-e4a7821e3ae8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:50.510430 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:50.511034 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:50.511311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:50.511604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:50.512287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:50.512589 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:50.514031 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c30bde-5cc7-41da-ac5d-37d9f303e2ec None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:50.526052 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 627/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:50.532200 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:50.631566 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ab13-ac95-4cd7-b33c-b7652c4b8f27 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:50.664517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:50.665105 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:50.665380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:50.665647 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:50.666634 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] RBAC: Adding query filter params (role.id=dc6bd2aa9093476aa45c05cd4d930025, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2414041e42704c978eff55e37c661221) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:50.666942 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:50.668393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8edeb-3932-458b-8f50-ac2332d4bcc2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:50.673910 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 619/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:02:50 2022] GET /identity/v3/role_assignments?user.id=2414041e42704c978eff55e37c661221&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=dc6bd2aa9093476aa45c05cd4d930025 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:52.630159 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777f60-7ec0-4731-a566-b6bb3b795498 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:52.630674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777f60-7ec0-4731-a566-b6bb3b795498 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:52.630674 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777f60-7ec0-4731-a566-b6bb3b795498 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:52.632324 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 628/1247] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:02:52.637592 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:52.638037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:52.638266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:52.644626 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:52.657589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:02:52.658802 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:02:52.723306 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 620/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:02:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:02:53.001240 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777f60-7ec0-4731-a566-b6bb3b795498 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:53.018958 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:53.102800 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777f60-7ec0-4731-a566-b6bb3b795498 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:53.136908 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:53.137525 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:53.137807 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:53.138112 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:53.147887 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:02:53.152484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:53.153453 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:53.154985 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 629/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:53.159771 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:53.257695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511ddd-c5bf-4bb4-a171-462b20bdd3d1 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:53.285249 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:53.290518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:53.291383 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:53.291657 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:53.291926 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:53.292577 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:53.292892 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:53.294266 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:53.301879 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 621/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:53.308119 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:53.384581 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:53.406615 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1b548-f520-43e1-aca0-fa69de0ab2c8 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:53.440657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:53.441353 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:53.441636 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:53.441909 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:53.452740 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:53.454220 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:53.468530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:53.469612 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:53.470568 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:53.470568 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:53.470568 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:53.470568 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 630/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:53.476260 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:53.578066 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36c78c-757f-446c-afe4-ff3b3aadbd17 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:53.611518 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:53.612120 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:53.612404 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:53.612684 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:53.613381 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:53.613683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:53.615310 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:53.626808 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 622/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:02:53.633278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:53.733876 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77729f-5bf8-4f7d-a695-4017c4287c45 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:53.759630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:53.767042 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:53.767662 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:53.767944 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:53.768217 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:53.776421 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:53.777852 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:02:53.789045 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:53.790238 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:53.791679 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 631/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:53.796229 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:53.850701 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:53.892674 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7244be0-0835-4ee2-a4fe-e02a9422c12c None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:53.927240 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:53.928398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:53.928727 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:53.929133 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:53.929859 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:53.930195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:53.931672 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:53.948917 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 623/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:53.954779 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:54.063271 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba5f8-0ec0-489c-ae05-72246566421f None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:54.095756 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:54.096349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:54.096626 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:54.096897 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:54.150641 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:54.162270 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:54.163699 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:54.259530 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 632/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:02:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:02:54.265453 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:54.367490 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5b9e-b50d-430b-becf-5c606542805f None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:54.380181 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:54.401784 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:54.402380 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:54.402663 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:54.402939 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:54.412798 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:54.414286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:54.429304 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:54.430862 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:54.431888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:54.431888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:54.431888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:54.431888 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 624/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:54.436354 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:54.523975 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:54.535562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2ce3-92e7-4b26-8a3c-4e67de8b8fe5 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:54.569744 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:54.570375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:54.570657 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:54.570929 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:54.571572 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:54.571874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:54.573278 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:54.585081 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 633/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:54.590821 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:54.688876 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2946-aa65-41bf-a562-aa5dba73b436 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:54.721899 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:54.722550 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:54.722827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:54.723093 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:54.730315 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:54.731791 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:02:54.743652 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:54.744689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:02:54.745668 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 625/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:54.751051 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:54.848334 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ae880-5b5a-46a3-9c6e-49af87856f6d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:54.881311 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:54.881910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:54.882210 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:54.882474 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:54.883148 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:54.883450 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:54.884918 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e76f3-5be9-460b-b5d8-b7c86d4bf5d1 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:54.896419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 634/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:54.902659 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:54.929732 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:55.001990 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587853b-4766-40bc-82a5-7ea9d73777d8 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:55.036190 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:55.036785 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:55.037222 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:55.037362 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:55.038040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2414041e42704c978eff55e37c661221) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:55.038346 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:55.039809 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec39a0-8961-452f-8a08-514ec9010740 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:55.045398 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 626/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:02:54 2022] GET /identity/v3/role_assignments?user.id=2414041e42704c978eff55e37c661221&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:56.922663 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406096-8994-49db-9fb1-559d66849de2 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:56.923224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406096-8994-49db-9fb1-559d66849de2 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:56.923224 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406096-8994-49db-9fb1-559d66849de2 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:56.924716 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 635/1261] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:02:56.930632 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:56.931063 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:56.931182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:56.949484 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:02:56.950743 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:02:57.015986 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 627/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:02:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:02:57.283375 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406096-8994-49db-9fb1-559d66849de2 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:57.294627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:57.382013 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406096-8994-49db-9fb1-559d66849de2 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:57.416321 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:57.416989 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:57.417265 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:57.417534 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:57.428261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:02:57.432951 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:57.434874 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:57.436160 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 636/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:57.440172 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:57.458283 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:57.537960 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cedf59-e9b3-4462-9f1d-07842ae03be0 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:57.571068 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746d9a3-f158-4514-82df-166708405198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:57.571671 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746d9a3-f158-4514-82df-166708405198 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:57.571951 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746d9a3-f158-4514-82df-166708405198 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:57.572224 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746d9a3-f158-4514-82df-166708405198 None admin] PATH_INFO: `/v3/roles` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:57.572886 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746d9a3-f158-4514-82df-166708405198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:57.573188 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746d9a3-f158-4514-82df-166708405198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:57.574584 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746d9a3-f158-4514-82df-166708405198 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:57.582720 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 628/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:57.589175 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:57.658061 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:57.690132 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3066343-778e-452a-872f-4d6ba669910d None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:57.723783 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:57.724452 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:57.724749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:57.725201 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:57.735887 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:57.737435 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:57.752323 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:57.753497 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:57.754639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:57.754639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:57.754639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:57.754639 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 637/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:57.760019 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746d9a3-f158-4514-82df-166708405198 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:57.840177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:57.858358 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746d9a3-f158-4514-82df-166708405198 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:57.891598 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:57.892199 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:57.892476 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:57.892746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:57.893418 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:57.893722 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:57.895126 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:57.906387 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 629/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:57.914469 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.016121 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe54ee-899c-41f0-a7fc-f2ebac101c6a None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:58.035566 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:58.049130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:58.049749 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:58.050090 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:58.050362 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:58.058253 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:58.059754 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:02:58.071398 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:58.072515 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:58.073711 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 638/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:58.078737 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.178700 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304445-6407-4f73-9566-faa6c1ebdc5d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:58.210941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:58.211540 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:58.211820 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:58.212095 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] PATH_INFO: `/v3/users` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:58.212812 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:58.213116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:58.214580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:58.224024 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:58.232914 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 630/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Aug 12 11:02:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:58.238887 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.336548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d79d-0381-46e1-af15-4584a8bf9513 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:58.370342 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:58.370965 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:58.371247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:58.371519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:58.381815 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:58.383296 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:02:58.397261 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:58.399085 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:02:58.399966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:02:58.399966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:02:58.399966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:58.399966 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 639/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:58.404369 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.503037 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3250-7031-4f4b-aad9-095fedd390a2 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:58.535619 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:58.536214 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:58.536491 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:58.536811 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:58.538166 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:58.538470 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:58.539853 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:58.551230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 631/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:58.557247 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.588432 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:58.655349 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82673b-fae6-4631-ac32-96f5b7445ebe None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:58.687969 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:58.688630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:58.688857 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:58.689124 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:58.695788 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:58.697215 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:02:58.707971 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:02:58.709519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:02:58.710706 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 640/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:02:58.715641 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.772689 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:58.813339 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99ab9-6462-4cd7-8c23-89fa59be7103 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:58.848810 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:58.849431 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:58.849711 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:58.850013 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:58.850739 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:02:58.851043 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:58.852492 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ed88-d66c-42b4-8991-6ae348702a23 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:58.864182 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 632/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:02:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:02:58.870431 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:02:58.960825 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:58.969244 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6dd2-9756-4f59-9336-3e5187d3dc9b None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:02:59.008941 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5d8fc-a003-49a8-b2ec-4e066fe02a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:02:59.009584 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5d8fc-a003-49a8-b2ec-4e066fe02a5e None admin] REQUEST_METHOD: `PUT` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:02:59.009861 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5d8fc-a003-49a8-b2ec-4e066fe02a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:02:59.010158 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5d8fc-a003-49a8-b2ec-4e066fe02a5e None admin] PATH_INFO: `/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2414041e42704c978eff55e37c661221/roles/aba02a0a6818431c93e25755ad1bbbbd` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:02:59.012056 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5d8fc-a003-49a8-b2ec-4e066fe02a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=52c40dcee6e0438ebc563b4a272274d4, user_id=2414041e42704c978eff55e37c661221, role_id=aba02a0a6818431c93e25755ad1bbbbd)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:02:59.013521 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5d8fc-a003-49a8-b2ec-4e066fe02a5e None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:02:59.108548 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 641/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Aug 12 11:02:58 2022] PUT /identity/v3/projects/52c40dcee6e0438ebc563b4a272274d4/users/2414041e42704c978eff55e37c661221/roles/aba02a0a6818431c93e25755ad1bbbbd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:03:01.185852 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125ca5-c651-48cf-9ba4-054e61089fec None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:01.186405 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125ca5-c651-48cf-9ba4-054e61089fec None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:01.186499 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125ca5-c651-48cf-9ba4-054e61089fec None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:01.187849 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 633/1274] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:03:01.193575 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:01.194027 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:01.194153 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:01.212590 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:03:01.213767 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:03:01.281197 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 642/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:03:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:03:01.553298 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125ca5-c651-48cf-9ba4-054e61089fec None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:01.653230 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125ca5-c651-48cf-9ba4-054e61089fec None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:01.670077 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:01.686774 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:01.687336 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:01.687615 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:01.687884 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:01.698302 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:03:01.702941 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:01.704102 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:01.704931 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 634/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Aug 12 11:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:01.710355 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:01.804080 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:01.824268 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6ef9-a87c-45da-86ed-068b43dfa4dc None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:01.861200 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:01.861818 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:01.862130 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:01.862395 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] PATH_INFO: `/v3/roles` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:01.863058 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:01.863362 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:01.865417 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:01.874559 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 643/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Aug 12 11:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:01.880705 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:01.996730 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd186107-7afa-4eda-b580-562442701e02 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:02.032671 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:02.033322 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:02.033601 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:02.033872 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:02.046714 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:02.048206 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:03:02.064242 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:02.068378 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:03:02.069279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:03:02.069279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:03:02.069279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:02.069279 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 635/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:02.072053 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:02.177819 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715853-ca29-4baf-bc6c-bc3dd6862397 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:02.212891 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:02.213490 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:02.213762 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:02.214065 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] PATH_INFO: `/v3/domains` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:02.214709 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:02.215011 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:02.216472 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:02.229275 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 644/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:02.235295 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:02.268955 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:02.337875 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c96ae-7d15-4486-b569-fbc92f7798c1 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:02.370669 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:02.371286 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:02.371561 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:02.371827 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:02.378582 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:02.380021 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:03:02.391239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:02.392337 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:02.393573 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 636/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:03:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:02.399031 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:02.402763 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:02.497842 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7bd75-f16f-49ea-8a70-3f35dc330075 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:02.530797 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:02.531339 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:02.531614 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:02.531886 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] PATH_INFO: `/v3/users` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:02.532604 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:02.532907 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:02.534351 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:02.551616 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 645/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Aug 12 11:03:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:02.557520 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:02.644691 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:02.654829 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00388fe-173e-4167-ab2b-0a757eedce56 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:02.689141 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:02.689733 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:02.690040 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:02.690311 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:02.758080 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:02.759695 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:02.845521 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:02.855393 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 637/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Aug 12 11:03:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:03:02.861162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:02.920910 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:02.958796 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736b1f1-d425-4600-8e37-d556a85248ce None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:02.993630 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:02.994285 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:02.994569 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:02.994846 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:03.004619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:03.007451 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:03:03.022640 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:03.023552 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:03:03.024448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:03:03.024448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:03:03.024448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:03:03.024448 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 646/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Aug 12 11:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:03.029654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:03.126239 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5236c8-ebcf-4bd2-88f6-437ba30af519 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:03.159175 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:03.159758 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:03.160036 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:03.160307 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] PATH_INFO: `/v3/domains` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:03.160944 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:03.161243 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:03.162692 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:03.173746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 638/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Aug 12 11:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:03.180129 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:03.278498 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc928-71fd-4cc6-bd8f-0426d1f57549 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:03.293764 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:03.316984 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:03.317600 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:03.318550 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:03.318795 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:03.325157 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:03.326619 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:03:03.337322 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:03.342519 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: ERROR keystone.server.flask.application Aug 12 11:03:03.343418 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 647/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Aug 12 11:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:03.344410 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:03.395116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:03.443627 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076059-edbc-4ea7-94b3-00f7f7512e2d None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:03.478436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:03.479042 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:03.479320 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:03.479595 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:03.480281 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:03.480580 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:03.482015 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac26a-b8a1-412d-bc63-95a9f7d486e8 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:03.494328 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 639/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Aug 12 11:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:03.500790 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:03.600245 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd51a-b2f8-46cc-8d3a-8fc705a7a7f6 None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:03.632393 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:03.632974 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:03.633246 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:03.633509 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:03.634249 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] RBAC: Adding query filter params (role.id=aba02a0a6818431c93e25755ad1bbbbd, scope.project.id=52c40dcee6e0438ebc563b4a272274d4, user.id=2414041e42704c978eff55e37c661221) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:03.634553 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:03.635956 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd832e1c-9559-4646-b542-854adc45c392 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:03.641505 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 648/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Aug 12 11:03:03 2022] GET /identity/v3/role_assignments?user.id=2414041e42704c978eff55e37c661221&scope.project.id=52c40dcee6e0438ebc563b4a272274d4&role.id=aba02a0a6818431c93e25755ad1bbbbd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:05.567655 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44264-cbf2-432c-979e-4847e25fcbf1 None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:05.568173 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44264-cbf2-432c-979e-4847e25fcbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:05.568287 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44264-cbf2-432c-979e-4847e25fcbf1 None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:05.569793 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 640/1288] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:03:05.574963 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:05.575340 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:05.575516 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:05.593561 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:03:05.597524 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:03:05.624234 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:05.659263 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 649/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:03:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:03:05.930186 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44264-cbf2-432c-979e-4847e25fcbf1 None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:06.029445 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44264-cbf2-432c-979e-4847e25fcbf1 None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:06.040402 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:06.062937 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:06.063563 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:06.063841 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:06.064113 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:06.064726 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:06.066116 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:06.074664 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:06.075885 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:06.076750 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 641/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:03:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:06.081773 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:06.184484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247747-abba-47b1-961e-b95e17b62fed None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:06.217938 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:06.218562 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:06.218844 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:06.219114 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:06.219745 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:06.220053 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:06.221408 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5b78c-3c0f-4218-a5d4-de69f4153600 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:06.226866 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 650/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Aug 12 11:03:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:06.232654 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:06.331579 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6390-a115-4a8a-babc-e0d48f7c0864 None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:06.364851 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:06.365519 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:06.365757 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:06.366059 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] PATH_INFO: `/v3/services` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:06.366718 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:06.367022 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:06.368374 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8cbc2-7a44-4aed-a0a7-5b1441a4c900 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:06.372653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 642/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Aug 12 11:03:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:08.284894 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e258b-b9cb-4a11-ba5c-5cb9238ac9e9 None None] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:08.285425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e258b-b9cb-4a11-ba5c-5cb9238ac9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:08.285425 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e258b-b9cb-4a11-ba5c-5cb9238ac9e9 None None] PATH_INFO: `/` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:08.286836 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 651/1293] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:03:08.292265 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075924-aab6-43b0-ac2a-f45e948ea709 None None] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:08.292682 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075924-aab6-43b0-ac2a-f45e948ea709 None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:08.292821 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075924-aab6-43b0-ac2a-f45e948ea709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:08.311193 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.auth.core [None req-a2075924-aab6-43b0-ac2a-f45e948ea709 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81712) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:03:08.312395 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.fernet_utils [None req-a2075924-aab6-43b0-ac2a-f45e948ea709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81712) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:03:08.341513 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:08.378269 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 643/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:03:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:03:08.646502 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e258b-b9cb-4a11-ba5c-5cb9238ac9e9 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:08.677549 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:08.749573 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e258b-b9cb-4a11-ba5c-5cb9238ac9e9 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:08.782325 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c094a-c4ae-4052-a122-9f5af6bb01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:08.782926 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c094a-c4ae-4052-a122-9f5af6bb01d6 None admin] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:08.783205 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c094a-c4ae-4052-a122-9f5af6bb01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:08.783477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c094a-c4ae-4052-a122-9f5af6bb01d6 None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:08.784128 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c094a-c4ae-4052-a122-9f5af6bb01d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:08.785477 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c094a-c4ae-4052-a122-9f5af6bb01d6 None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:08.869287 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 652/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Aug 12 11:03:08 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:03:10.774292 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3bee-ee9a-41f4-9d04-aabc5587369d None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:10.774828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3bee-ee9a-41f4-9d04-aabc5587369d None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:10.774828 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3bee-ee9a-41f4-9d04-aabc5587369d None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:10.776222 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 644/1296] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:03:10.781221 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:10.781650 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:10.781794 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:10.800707 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:03:10.801873 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:03:10.873043 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 653/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:03:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:03:11.144195 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3bee-ee9a-41f4-9d04-aabc5587369d None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:11.244013 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3bee-ee9a-41f4-9d04-aabc5587369d None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:11.276974 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:11.277589 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:11.277868 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:11.278203 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:11.278783 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:11.280132 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:11.289786 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:11.291236 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:11.292179 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 645/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:03:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:11.297363 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:11.315414 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:11.394937 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da83a-c7cf-45ad-be17-1f9556c34f22 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:11.428419 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:11.429019 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:11.429302 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:11.429577 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:11.430237 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:11.430546 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:11.431944 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:11.437180 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 654/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Aug 12 11:03:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:11.443070 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:11.475683 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:11.543437 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d1c3-17be-4960-9fdb-e95d5e7583ad None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:11.577547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:11.578177 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:11.578479 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:11.578746 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:11.579436 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] RBAC: Adding query filter params (interface=public, service_id=18456be617f446e0b5db726113651153, region_id=RegionOne) {{(pid=81712) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:11.579738 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:11.581081 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f297d1-6f04-4e8b-9e54-fa77d6809089 None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:11.587444 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 646/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Aug 12 11:03:11 2022] GET /identity/v3/endpoints?service_id=18456be617f446e0b5db726113651153&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:11.593189 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:11.671680 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:11.688627 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e211a-8bd4-4c93-92f9-9aaf64eff0ca None admin] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:11.721862 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654450c-5b20-4bc7-8105-58935e54f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:11.722484 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654450c-5b20-4bc7-8105-58935e54f1fd None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:11.722761 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654450c-5b20-4bc7-8105-58935e54f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:11.723029 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654450c-5b20-4bc7-8105-58935e54f1fd None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:11.723621 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654450c-5b20-4bc7-8105-58935e54f1fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:11.725002 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654450c-5b20-4bc7-8105-58935e54f1fd None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:11.731724 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 655/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Aug 12 11:03:11 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:03:13.597460 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3134c6-82c5-4129-b211-7ca3fe72c4cc None None] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:13.598025 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3134c6-82c5-4129-b211-7ca3fe72c4cc None None] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:13.598025 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3134c6-82c5-4129-b211-7ca3fe72c4cc None None] PATH_INFO: `/` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:13.599948 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 647/1302] 10.222.0.40 () {54 vars in 927 bytes} [Fri Aug 12 11:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:03:13.605299 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] REQUEST_METHOD: `POST` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:13.609427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:13.609427 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:13.623765 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.auth.core [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] MFA Rules not processed for user `4eef8c08fd624006b0498b56eda3d377`. Rule list: `[]` (Enabled: `True`). {{(pid=81711) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:03:13.624930 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.fernet_utils [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81711) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:03:13.697532 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 656/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Fri Aug 12 11:03:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:03:13.968801 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3134c6-82c5-4129-b211-7ca3fe72c4cc None None] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:14.061594 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=100 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:14.068887 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3134c6-82c5-4129-b211-7ca3fe72c4cc None None] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:14.101547 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:14.102194 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] REQUEST_METHOD: `GET` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:14.102471 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:14.102736 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:14.103305 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:14.104653 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:03:14.113065 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:03:14.116806 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application with Lock( Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: ERROR keystone.server.flask.application Aug 12 11:03:14.117845 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 648/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Aug 12 11:03:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:03:14.120898 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] Authenticating user token {{(pid=81711) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:14.197162 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=100 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:14.219040 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc745a02-fc36-4972-a828-325e4bf15224 None None] Validating token access rules against request {{(pid=81711) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:14.251700 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81711) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:14.252301 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] REQUEST_METHOD: `GET` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:14.252583 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] SCRIPT_NAME: `/identity` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:14.252856 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] PATH_INFO: `/v3/services` {{(pid=81711) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:14.253485 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81711) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:03:14.253789 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:14.255218 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cf3e5-fe64-4556-b25c-0fbf41ff275f None admin] RBAC: Authorization granted {{(pid=81711) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:14.260734 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: [pid: 81711|app: 0|req: 657/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Aug 12 11:03:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:03:14.266678 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] Authenticating user token {{(pid=81712) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:03:14.365803 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e4cef-440e-43e7-9e03-0e2cba8dbaef None admin] Validating token access rules against request {{(pid=81712) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:03:14.398387 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b67a0-bda0-4938-98f9-8b4d0dcf407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eef8c08fd624006b0498b56eda3d377', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81712) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:03:14.398977 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b67a0-bda0-4938-98f9-8b4d0dcf407a None admin] REQUEST_METHOD: `POST` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:03:14.399252 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b67a0-bda0-4938-98f9-8b4d0dcf407a None admin] SCRIPT_NAME: `/identity` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:03:14.399517 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b67a0-bda0-4938-98f9-8b4d0dcf407a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81712) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:03:14.400167 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b67a0-bda0-4938-98f9-8b4d0dcf407a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:03:14.401511 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b67a0-bda0-4938-98f9-8b4d0dcf407a None admin] RBAC: Authorization granted {{(pid=81712) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:03:14.486335 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: [pid: 81712|app: 0|req: 649/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Aug 12 11:03:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:03:24.273601 dv-cinder-852828-1-iscsi devstack@keystone.service[81711]: DEBUG dbcounter [-] [81711] Writing DB stats keystone:SELECT=30 {{(pid=81711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:03:24.481583 dv-cinder-852828-1-iscsi devstack@keystone.service[81712]: DEBUG dbcounter [-] [81712] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}